-- Logs begin at Wed 2022-08-24 10:46:21 UTC, end at Wed 2022-08-24 11:44:48 UTC. -- Aug 24 11:17:30.408770 dv-cinder-854275-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:17:30.418234 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:17:30 2022] *** Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: nodename: dv-cinder-854275-3-iscsi Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: machine: x86_64 Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: clock source: unix Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: pcre jit disabled Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: detected number of CPU cores: 4 Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: current working directory: / Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:17:30.420218 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: your processes number limit is 47680 Aug 24 11:17:30.420865 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: your memory page size is 4096 bytes Aug 24 11:17:30.420865 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: detected max file descriptor number: 2048 Aug 24 11:17:30.420865 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: lock engine: pthread robust mutexes Aug 24 11:17:30.420865 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: thunder lock: enabled Aug 24 11:17:30.420865 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:17:30.420865 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:17:30.459892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: Python main interpreter initialized at 0x5615033029c0 Aug 24 11:17:30.459892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: python threads support enabled Aug 24 11:17:30.459892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: your server socket listen backlog is limited to 100 connections Aug 24 11:17:30.459892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:17:30.460306 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:17:30.460306 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: *** Operational MODE: preforking *** Aug 24 11:17:30.460573 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:17:30.460573 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: spawned uWSGI master process (pid: 105466) Aug 24 11:17:30.460780 dv-cinder-854275-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:17:30.462892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: spawned uWSGI worker 1 (pid: 105467, cores: 1) Aug 24 11:17:30.462892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: spawned uWSGI worker 2 (pid: 105468, cores: 1) Aug 24 11:17:30.462892 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:17:31.131272 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:17:31.136663 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:17:32.222408 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:17:32.222408 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: from cryptography.utils import int_from_bytes Aug 24 11:17:32.223081 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:17:32.223081 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: from cryptography.utils import int_from_bytes Aug 24 11:17:32.226276 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:17:32.226276 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: from cryptography.utils import int_from_bytes Aug 24 11:17:32.226693 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:17:32.226693 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: from cryptography.utils import int_from_bytes Aug 24 11:17:34.748653 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:17:34.749341 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:17:34.749435 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:17:34.749928 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:17:34.750025 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:17:34.750123 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:17:34.750204 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:17:34.750281 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:17:34.750371 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:17:34.750449 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.750605 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:17:34.750743 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.750985 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.751092 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.751311 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.751503 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.751628 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.751715 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.751940 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752025 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752262 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752358 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752566 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752652 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752883 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.752980 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.753154 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.753271 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.753499 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.753584 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.753792 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.753897 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-3-iscsi {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.754088 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.754182 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.754402 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-3-iscsi {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.754494 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.754723 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.754884 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755037 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755181 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755329 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755471 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755600 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.755879 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.756026 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.756200 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.756440 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.758472 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.758678 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.758829 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.758993 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.759139 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.759299 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.759446 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.759585 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.759726 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.759876 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.760035 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.760336 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.760539 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.760757 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.760959 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.761158 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.761419 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.761419 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.761833 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.762033 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.762231 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.762430 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.762643 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-3-iscsi {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.762840 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-3-iscsi {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763038 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763250 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763442 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763586 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763713 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763836 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.763968 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.764115 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.764241 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.764405 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.764601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765007 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765170 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765333 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765468 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765600 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765736 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765861 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.765989 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766120 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766249 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766372 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766507 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766631 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766755 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.766884 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767015 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767137 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767272 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767396 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767518 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767640 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767762 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.767893 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768017 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768144 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768266 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768388 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768520 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768652 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768775 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.768898 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769020 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769140 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769290 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769434 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769559 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769695 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769821 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.769947 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.770087 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.770219 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.770352 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.770526 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.770703 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.770863 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771009 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771140 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771264 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771394 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771518 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771649 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771781 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.771904 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772034 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772165 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772288 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772423 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772423 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772655 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772777 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.772898 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773028 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773160 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773323 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773446 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773568 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773690 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773826 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.773951 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774073 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774196 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774318 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774440 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774572 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774696 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774818 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.774975 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775172 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775308 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775442 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775566 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775687 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775817 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.775947 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.776069 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.776201 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.776325 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.776446 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.776607 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.776814 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777021 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777167 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777311 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777434 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777555 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777677 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.777880 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778006 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778128 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778249 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778376 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778498 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778630 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778754 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778875 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.778997 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779118 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779240 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779375 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779629 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779758 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.779877 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780012 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780136 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780265 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780398 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780530 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780653 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780784 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.780911 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781033 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781145 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781356 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781493 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781626 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781757 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.781887 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782011 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782131 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782259 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782391 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782522 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782652 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782776 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.782897 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783027 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783158 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783281 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783410 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783542 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783665 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783797 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.783930 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784066 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784190 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784312 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784433 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784433 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784690 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784690 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.784930 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785050 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785178 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785401 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785538 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785671 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785800 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.785999 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786185 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786326 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786452 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786584 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786716 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786848 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.786972 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787104 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787228 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787351 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787470 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787599 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787724 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.787887 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788025 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788185 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788324 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788485 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788612 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788785 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.788914 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.789087 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.789275 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.789415 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.789541 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.790209 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.790342 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.790517 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.790643 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.790834 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.790971 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.791154 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.791273 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.791463 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.791590 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.791767 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.791913 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.792069 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.792197 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.792384 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.792512 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.792707 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:17:34.792838 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.793039 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.793173 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.793403 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.793528 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.793716 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.793861 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.794060 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.794184 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.794399 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.794737 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.794864 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.795060 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.795188 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.795451 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.795588 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.795726 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.795853 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796012 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796141 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796328 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796455 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796649 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796776 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.796965 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.797100 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.797304 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.797446 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.797647 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.797856 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.797992 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.798115 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.798272 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.798433 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.798629 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.798804 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.799012 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.799217 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.799418 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.799640 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.799821 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.799951 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800083 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800208 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800341 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800485 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800611 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800735 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800859 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.800982 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.801112 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.801281 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.801403 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.801526 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.801694 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.801822 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.802005 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.802143 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.802315 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.802451 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.802713 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.802846 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803030 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803166 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803357 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803486 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803664 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803789 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.803986 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.804121 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.804309 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.804443 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.804608 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.804806 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.805013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.805291 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.806050 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.806330 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.806330 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.806728 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.806878 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807006 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807129 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807262 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807394 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807536 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807663 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807786 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.807909 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808040 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808175 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808309 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808441 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808572 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808741 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808867 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.808991 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.809174 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.809323 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.809514 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.809650 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.809814 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.809939 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.810123 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.810251 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.810427 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.810555 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.810745 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.810888 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.811071 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.811207 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.811376 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.811504 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.811708 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.811844 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812014 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812160 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812305 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812420 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812615 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812738 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.812921 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813037 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813257 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813402 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813558 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813693 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813868 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.813997 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.814172 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.814298 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.814492 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.814629 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.814803 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.814973 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.815172 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.815328 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.815453 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.815577 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.815723 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.815850 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816031 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816158 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816357 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816565 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816712 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816840 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.816973 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.817097 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.817280 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.817429 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.817594 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.817751 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.817916 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.818046 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.818230 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.818359 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.818541 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.818666 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.818877 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.819034 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.819202 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.819449 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.819577 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.819812 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.820014 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.820159 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.820417 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.820546 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.820730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.820856 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.821064 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.821355 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.821490 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.821622 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.821730 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.821851 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822045 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822183 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822358 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822485 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822667 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822796 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.822972 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.823097 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.823278 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.823406 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.823583 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.823709 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.823888 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824015 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824195 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824320 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824506 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824632 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824809 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.824934 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.825114 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.825259 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.825440 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.825560 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.825748 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.825895 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.826071 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.826205 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.826411 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.826742 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.826873 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.827063 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.827263 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.827389 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.827624 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.827835 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.827972 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.828100 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.828279 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.828404 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.828588 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.828729 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.828896 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829030 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829222 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829352 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829544 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829686 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829852 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.829987 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.830170 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.830297 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.830477 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.830604 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.830798 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.830924 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.831105 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.831232 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.831422 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.831549 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.831722 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.831849 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.832033 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.832158 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.832356 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.832509 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.832703 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.832910 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.833105 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.833336 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.833563 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.833743 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.833873 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.833998 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834125 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834257 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834390 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834514 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834637 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834759 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.834891 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835024 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835156 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835280 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835416 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835588 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835708 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.835906 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.836036 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.836225 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.836352 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.836544 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.836759 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.836901 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.837028 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.837257 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.837402 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.837567 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.837702 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.837883 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838010 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838212 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838340 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838529 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838664 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838855 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.838981 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.839166 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.839337 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.839534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.839750 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.839948 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.840143 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.840350 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.840549 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.840549 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.840935 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.841147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.841361 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.841586 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.841757 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.841928 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842107 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842274 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842401 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842401 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842633 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842633 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.842889 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843135 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843258 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843382 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843514 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843639 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843762 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.843892 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844017 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844147 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844280 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844407 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844530 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844656 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844786 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.844910 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845042 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845166 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845386 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845514 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845690 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845809 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.845992 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.846129 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.846311 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.846439 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.846616 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.846766 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.846974 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.847100 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.847223 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.847352 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.847592 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.847800 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848010 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848210 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848405 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848540 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848664 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848798 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.848923 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849046 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849168 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849315 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849438 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849652 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849786 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.849909 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850032 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850197 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850333 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850510 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850637 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850822 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.850949 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.851128 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.851264 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.851435 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.851561 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.851741 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.851869 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.852048 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.852669 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.852876 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.852998 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.853253 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.853359 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.853523 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.853618 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.853883 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854022 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854228 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854354 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854491 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854618 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854762 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.854969 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.855168 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.855369 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.855577 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.855789 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.855933 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856041 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856338 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856468 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856602 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856726 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856848 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.856997 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.857158 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.857302 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.857512 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.857645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.857769 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.857973 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.858099 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.858354 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.858491 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.858664 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.858790 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.858966 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.859101 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.859266 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.859406 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.859573 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.859699 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.859875 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860000 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860176 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860311 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860476 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860616 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860782 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.860910 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.861082 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.861273 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.861414 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.861589 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.861788 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.861986 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.862186 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.862328 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.862470 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.862604 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.862727 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.862858 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.863144 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.863284 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.863461 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.863715 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.863848 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.864039 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.864166 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.864340 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.864546 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.864674 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.864964 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.865089 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.865288 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.865460 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.865624 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.865796 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.865950 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.866485 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.866709 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.866847 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.867015 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.867142 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.867348 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.867478 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.867711 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.867849 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.868577 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.868698 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.868858 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.869045 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.869163 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.869566 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.869654 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.869868 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.870115 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.870201 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.870470 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.870733 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.870827 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.871074 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.871204 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.871372 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.871660 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.871791 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.871966 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.872120 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.872381 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.872514 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.872683 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.872871 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.872998 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.873223 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.873354 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.873563 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.873693 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.873872 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.874010 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.874174 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.874304 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.874481 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.874658 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.874817 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.875066 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.875224 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.875358 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.875574 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.875712 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.875902 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.876029 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.876229 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.876367 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.876533 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.876662 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.876881 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.877137 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.877328 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.877465 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.877643 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.877771 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.877973 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.878110 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.878333 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.878468 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.878632 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.878901 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879029 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879219 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879352 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879535 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879665 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879845 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.879972 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.880142 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.880360 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.880501 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.880735 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.880921 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.881049 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.881348 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.881521 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.881651 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.881937 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.882062 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.882233 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.882468 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.882603 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.882800 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.882926 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.883102 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.883228 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.883503 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.883655 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.883825 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884086 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884214 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884393 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884548 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884742 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884861 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.884976 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.885181 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.885349 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.885544 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.885661 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.885869 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.885983 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.886187 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.886316 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.886502 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.886631 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.886822 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887049 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887186 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887320 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887454 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887582 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887745 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.887881 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888084 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888243 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888381 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888508 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888681 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888801 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.888997 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.889124 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.889334 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.889465 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.889647 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.889782 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.889957 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.890100 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.890272 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.890407 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.890580 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.890707 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.890888 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891025 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891203 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891329 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891524 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891652 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891826 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.891968 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.892133 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.892267 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.892443 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.892583 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.892749 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.892885 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893057 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893283 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893401 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893506 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893683 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893815 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.893993 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.894120 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.894302 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.894429 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.894613 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.894750 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.894920 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895046 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895223 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895350 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895528 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895656 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895834 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.895963 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.896136 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.896263 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.896456 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.896584 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.896763 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.896890 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.897072 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.897251 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.897397 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.897541 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.897704 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.897834 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898009 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898145 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898308 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898420 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898641 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898768 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.898958 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.899117 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.899413 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.899525 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.899716 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.899859 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.900024 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.900333 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.900453 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.900645 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.900759 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.900959 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.901082 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.901280 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.901399 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.901630 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.901768 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.901950 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.902093 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.902270 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.902397 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.902578 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.902703 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.902879 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903023 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903177 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903304 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903485 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903612 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903804 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.903938 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.904117 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.904237 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.904432 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.904560 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.904747 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.904882 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.905055 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.905191 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.905409 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.905618 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.905827 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.905979 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.906105 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.906229 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.906386 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.906507 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.906697 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.906825 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.907014 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.907156 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.907357 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.907469 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.907698 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.907795 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.908023 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.908227 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.908401 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.908610 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.908828 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.908959 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909083 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909270 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909399 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909537 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909664 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909786 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.909908 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910039 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910212 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910349 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910554 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910680 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910868 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.910994 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.911169 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.911306 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.911488 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.911617 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.911806 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.911933 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.912118 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.912246 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.912433 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.912560 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.912760 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.912895 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.913069 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.913214 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.913409 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.913653 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.913795 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.913925 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.914049 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.914172 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.914307 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.914440 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.914627 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.915381 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.915576 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.915803 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.916044 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.916293 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.916431 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.916728 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.916828 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.916976 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.917255 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.917422 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.917567 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.917705 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.917844 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918011 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918183 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918301 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918481 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918584 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918800 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.918902 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.919102 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.919211 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.919421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.919518 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.919732 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.919839 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920049 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920137 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920366 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920463 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920667 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920773 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.920987 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.921074 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.921324 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.921423 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.921655 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.921761 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.921959 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.922057 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.922261 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.922348 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.922596 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.922685 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.922897 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923016 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923216 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923345 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923545 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923662 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923867 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.923991 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.924173 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.924324 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.924503 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.924635 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.924828 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.924946 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.925143 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.925338 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.925482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.925580 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.925803 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.925890 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.926106 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.926207 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.926405 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.926493 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.926732 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.926819 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927015 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927127 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927325 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927474 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927616 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927758 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.927915 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928073 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928219 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928357 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928525 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928696 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928852 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.928993 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.929166 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.929384 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.929535 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.929674 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.929824 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.929964 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.930101 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.930237 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.930442 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.931074 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.931238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.931518 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.931684 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.931959 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.932150 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.932312 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.932467 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.932607 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.932744 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.932910 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.933057 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.933311 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.933462 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.933626 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.933831 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934029 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934195 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934356 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934515 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934662 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934800 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.934936 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935072 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935218 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935356 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935492 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935629 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935764 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.935908 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.936054 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.936201 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.936338 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.936473 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.936609 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.936754 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937159 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937348 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937486 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937623 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937773 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.937911 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.938047 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.938197 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.938334 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.938490 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.938729 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.938881 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939026 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939164 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939300 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939474 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939631 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939771 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.939921 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.940161 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.940381 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.940715 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.940948 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.941179 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.941396 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.941539 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.941707 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.941949 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.942187 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.942408 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.942634 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.942784 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.942945 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.943094 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.943232 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.943369 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.943553 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.943772 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944024 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944232 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944378 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944515 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944652 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944789 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.944978 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.945174 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.945340 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.945491 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.945679 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.945910 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.946185 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.946407 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.946623 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.946839 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.947098 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.947307 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.947509 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.947716 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.947866 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.947866 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.948130 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.948278 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.948278 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.948544 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.948701 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.948930 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.949074 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.949260 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.949418 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.949569 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.949707 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.949874 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950025 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950163 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950306 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950540 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950540 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950837 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.950984 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.951176 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.951418 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.951641 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.951793 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.951940 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952088 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952227 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952374 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952512 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952649 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952805 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.952944 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953082 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953246 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953393 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953542 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953697 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953836 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.953981 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954118 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954264 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954401 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954551 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954551 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954825 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.954963 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955099 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955254 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955393 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955538 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955675 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955810 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955946 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.955946 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.956221 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.956359 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.956507 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.956646 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.956782 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.956942 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.957080 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.957298 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.957475 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.957617 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.957775 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.957915 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958053 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958199 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958336 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958483 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958631 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958769 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.958938 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.959158 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.959302 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.959447 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.959594 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.959734 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.959871 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960008 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960145 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960145 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960418 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960556 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960712 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960852 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.960988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.961134 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.961333 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.961484 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.961670 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.961813 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.961950 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.962096 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.962237 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.962459 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.962615 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.962766 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.963320 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.963475 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.963616 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.963753 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.963898 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964036 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964188 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964333 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964471 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964614 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964761 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.964899 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965057 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965221 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965368 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965505 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965505 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965763 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.965917 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966056 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966192 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966328 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966473 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966473 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966751 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.966906 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.967053 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.967197 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.967349 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.968268 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.968419 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.968566 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.968744 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.968967 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.969418 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.969643 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.969865 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970112 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970275 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970416 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970564 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970703 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970849 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.970987 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.971139 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.971139 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.971139 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.971625 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.971763 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.971763 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972033 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972170 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972318 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972318 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972318 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972318 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972318 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.972952 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973089 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973246 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973399 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973547 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973698 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973850 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.973987 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.974125 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.974260 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.974398 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.974541 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.974690 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.975207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.975354 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.975492 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.975630 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.975772 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.975971 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.976116 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.976335 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.976556 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.976786 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.977033 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.977854 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.978079 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.978289 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.978473 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.978674 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.978830 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.978981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.979119 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.979324 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.979672 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.979897 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.980129 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.980348 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.980572 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.980784 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.980958 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.981146 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.981315 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.981457 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.981673 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.981891 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.982103 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.982335 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.982551 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.982790 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.982995 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.983211 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.983421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.983668 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.983874 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984020 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984212 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984397 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984537 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984537 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984811 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.984951 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985089 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985262 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985421 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985571 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985711 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985848 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.985995 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986144 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986292 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986430 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986568 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986705 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986851 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.986990 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.987137 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.987284 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.987429 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.987567 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.987704 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.987860 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988000 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988138 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988275 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988430 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988660 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988843 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.988985 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.989124 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.989284 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.989478 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.989820 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.990074 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.990281 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.990424 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.990562 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.990712 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.990948 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.991175 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.991666 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.991899 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.992127 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.992358 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.992598 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.992858 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.993646 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.993783 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.993872 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.993955 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994059 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994142 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994222 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994301 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994385 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994454 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994530 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994605 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994673 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994738 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994738 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994864 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994932 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.994997 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995070 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995138 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995216 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995291 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995359 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995425 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995493 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995567 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995635 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995708 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995811 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995879 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.995945 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996010 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996083 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996151 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996224 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996291 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996355 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996420 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996420 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996553 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996640 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996708 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996773 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996845 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996920 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.996998 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997065 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997130 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997210 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997281 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997541 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997638 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997849 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.997939 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.998182 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.998279 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.998495 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.998626 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.998856 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.999073 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.999170 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.999416 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.999530 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.999744 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:34.999981 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.000085 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.000353 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.000520 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.000659 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.000752 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.000976 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.001160 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.001391 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.001544 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.001692 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.001838 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002013 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002171 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002324 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002470 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002757 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.002903 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003042 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003200 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003340 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003485 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003636 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003787 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.003925 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.004077 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.004241 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.004387 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.004555 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.004863 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005023 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005178 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005380 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005527 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005672 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005818 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.005987 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.006141 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.006293 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.006437 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.006582 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.006732 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.006886 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.007038 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.007186 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.007331 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.007500 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.007684 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.007862 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.008008 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.008152 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.008297 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.008480 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.008644 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.008902 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.009062 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.009467 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.009712 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.009994 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.010197 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.010394 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.010493 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.010716 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.010814 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011057 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011157 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011357 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011443 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011673 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011768 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.011992 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.012103 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.012258 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:17:35.012423 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.012633 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.012967 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.013314 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.013650 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.013977 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.014307 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.014631 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.014951 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.015288 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.015607 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.015926 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.016243 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.016563 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.016879 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.017237 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.017544 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.017863 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.018186 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.018506 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.018840 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.019171 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.019492 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.019823 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.020157 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.020515 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.020834 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.021187 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.021555 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.021959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.022260 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.022503 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:17:35.022951 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:17:35.180865 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Registered counter for database nova_api Aug 24 11:17:35.183368 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Registered counter for database nova_api Aug 24 11:17:35.204077 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.208454 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.210984 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.217859 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.268749 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.context [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c(cell1) {{(pid=105467) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:17:35.272706 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:35.273188 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:35.276215 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:35.276982 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:35.277102 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.context [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c(cell1) {{(pid=105468) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:17:35.277457 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:35.279474 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:35.280992 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:35.281511 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:35.281965 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Registered counter for database nova_cell0 Aug 24 11:17:35.283091 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:35.283840 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:35.284290 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:35.286352 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:35.287850 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Registered counter for database nova_cell1 Aug 24 11:17:35.288365 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Registered counter for database nova_cell0 Aug 24 11:17:35.295208 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Registered counter for database nova_cell1 Aug 24 11:17:35.296392 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.299428 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.304386 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.307453 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.308852 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.309729 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.314557 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.452035 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Registered counter for database nova_cell0 Aug 24 11:17:35.456436 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.461120 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.466076 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Registered counter for database nova_cell0 Aug 24 11:17:35.467175 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.475097 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:17:35.480888 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:17:35.817856 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:17:35.822603 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:17:35.825122 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:17:35.829824 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:17:36.181627 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:17:36.183375 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:17:36.187639 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:17:36.189335 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:17:36.192856 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615033029c0 pid: 105467 (default app) Aug 24 11:17:36.194559 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615033029c0 pid: 105468 (default app) Aug 24 11:17:36.194939 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:36.196631 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-6e53d449-4781-49ac-8dfe-7cb78ad01950 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Aug 24 11:17:36.197226 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Aug 24 11:17:36 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:59.318153 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:59.319994 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004588 Aug 24 11:18:59.320404 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:59.342477 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:59.345184 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_cell1:SELECT=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:59.346438 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_cell0:SELECT=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:59.347541 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:00.623397 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-d8385864-4ac8-4af0-a193-088bf720d10c admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:00.662272 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-d8385864-4ac8-4af0-a193-088bf720d10c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.332916 Aug 24 11:19:00.663279 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 11:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:03.567344 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:03.568366 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-7942a6aa-7577-4b19-a13e-1379f97aeaef None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 24 11:19:03.574139 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:04.180793 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-28ad65b8-aa6c-4134-b7fa-101f31519f78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:04.202468 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:19:04.202468 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: warnings.warn(msg) Aug 24 11:19:04.234022 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-28ad65b8-aa6c-4134-b7fa-101f31519f78 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.658275 Aug 24 11:19:04.234602 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:19:04.484385 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-b941a9d2-ca4d-4338-b7b1-96d620478902 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:04.489840 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:19:04.489840 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: warnings.warn(msg) Aug 24 11:19:04.492972 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=3 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:04.493920 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell0:SELECT=3 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:04.495343 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell1:SELECT=3 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:04.495988 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:04.571224 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-b941a9d2-ca4d-4338-b7b1-96d620478902 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.327063 Aug 24 11:19:04.572203 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 11:19:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:19:07.521176 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-28ad65b8-aa6c-4134-b7fa-101f31519f78 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:07.522770 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-28ad65b8-aa6c-4134-b7fa-101f31519f78 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Aug 24 11:19:07.524518 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:08.542257 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-08d7a4e1-7d7b-47dd-a0c3-536e04bb7d81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "swap": 0, "vcpus": 1, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:08.574278 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:19:08.574278 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: warnings.warn(msg) Aug 24 11:19:08.608413 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-08d7a4e1-7d7b-47dd-a0c3-536e04bb7d81 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.074112 Aug 24 11:19:08.609791 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:08.630438 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-e8e87247-cc9c-4114-8535-f6b39454db75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:08.636491 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:19:08.636491 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: warnings.warn(msg) Aug 24 11:19:08.686904 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-e8e87247-cc9c-4114-8535-f6b39454db75 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063581 Aug 24 11:19:08.687623 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 11:19:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:19:11.399301 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-08d7a4e1-7d7b-47dd-a0c3-536e04bb7d81 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:11.400973 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-08d7a4e1-7d7b-47dd-a0c3-536e04bb7d81 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002472 Aug 24 11:19:11.401717 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:11.930930 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-23a4cbd2-5d99-4df1-842b-e6959982bbaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "name": "ds1G"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:11.953279 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-23a4cbd2-5d99-4df1-842b-e6959982bbaa admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541021 Aug 24 11:19:11.954121 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:11.974567 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-ddfe7218-91cc-42fe-ae71-021893be92d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:12.013502 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-ddfe7218-91cc-42fe-ae71-021893be92d1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045234 Aug 24 11:19:12.014079 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 11:19:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:14.675824 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-23a4cbd2-5d99-4df1-842b-e6959982bbaa admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:14.677880 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-23a4cbd2-5d99-4df1-842b-e6959982bbaa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002657 Aug 24 11:19:14.678574 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:15.215315 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-a5bd0d7b-32a4-49e7-893a-ad8714eb6000 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:15.237123 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-a5bd0d7b-32a4-49e7-893a-ad8714eb6000 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550052 Aug 24 11:19:15.237123 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:15.249923 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-d38947bf-82c2-4ff3-b9dd-8c6486942b3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:15.277016 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-d38947bf-82c2-4ff3-b9dd-8c6486942b3d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030671 Aug 24 11:19:15.277643 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 11:19:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:17.946709 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-a5bd0d7b-32a4-49e7-893a-ad8714eb6000 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:17.947672 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-a5bd0d7b-32a4-49e7-893a-ad8714eb6000 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 11:19:17.948278 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:19:18.532381 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-336c9b29-0f96-446d-89ba-fee290668bc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:18.566173 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-336c9b29-0f96-446d-89ba-fee290668bc1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.608302 Aug 24 11:19:18.568589 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:19:18.578735 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-ee78632d-6c26-4395-9911-aa9ac8b12ffd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:18.610633 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-ee78632d-6c26-4395-9911-aa9ac8b12ffd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035570 Aug 24 11:19:18.617711 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Aug 24 11:19:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:21.243591 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-336c9b29-0f96-446d-89ba-fee290668bc1 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:21.244444 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-336c9b29-0f96-446d-89ba-fee290668bc1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 24 11:19:21.244847 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:21.722963 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-5baa709c-7a3a-4a1a-8e43-1a76528d3642 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:21.747221 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-5baa709c-7a3a-4a1a-8e43-1a76528d3642 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.495647 Aug 24 11:19:21.747757 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 11:19:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:24.152592 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-336c9b29-0f96-446d-89ba-fee290668bc1 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:24.153787 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-336c9b29-0f96-446d-89ba-fee290668bc1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 11:19:24.154190 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:24.676236 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-58f3753c-b13a-4875-833b-47278ec70af9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:24.704442 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-58f3753c-b13a-4875-833b-47278ec70af9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.544240 Aug 24 11:19:24.705810 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:24.718169 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a4f60760-0533-46a3-aff3-c8663f3489b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:24.750511 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-a4f60760-0533-46a3-aff3-c8663f3489b7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035842 Aug 24 11:19:24.751473 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 11:19:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:27.260727 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-58f3753c-b13a-4875-833b-47278ec70af9 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:27.261775 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-58f3753c-b13a-4875-833b-47278ec70af9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 11:19:27.262169 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:27.672071 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a7a07697-861b-4431-aba8-7b93e163343d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:27.691008 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-a7a07697-861b-4431-aba8-7b93e163343d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422785 Aug 24 11:19:27.691558 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:27.704624 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-2ad4cca5-5462-405a-ac15-4c334906e633 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:27.730397 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-2ad4cca5-5462-405a-ac15-4c334906e633 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029888 Aug 24 11:19:27.731398 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 11:19:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:19:30.102360 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a7a07697-861b-4431-aba8-7b93e163343d admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:30.103512 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-a7a07697-861b-4431-aba8-7b93e163343d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001915 Aug 24 11:19:30.104006 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:30.525462 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-9e8c6de0-eb65-4887-9202-d0b5bafd8d6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "vcpus": 2, "ram": 4096}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:30.546809 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-9e8c6de0-eb65-4887-9202-d0b5bafd8d6e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435696 Aug 24 11:19:30.547662 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:30.559927 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-33f02e37-3610-43e6-bb97-c35b7b850cbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:30.569601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:30.593568 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-33f02e37-3610-43e6-bb97-c35b7b850cbc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037559 Aug 24 11:19:30.594787 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 11:19:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:33.106504 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-9e8c6de0-eb65-4887-9202-d0b5bafd8d6e admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:33.107405 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-9e8c6de0-eb65-4887-9202-d0b5bafd8d6e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Aug 24 11:19:33.107794 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:33.672012 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-e7f9b29e-d97d-47cf-904c-48d74d5394fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "4", "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:33.700768 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-e7f9b29e-d97d-47cf-904c-48d74d5394fa admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.585850 Aug 24 11:19:33.702114 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:33.714987 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-463843bd-bfce-4641-82f8-a8393a5960ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:33.746086 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-463843bd-bfce-4641-82f8-a8393a5960ce admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034730 Aug 24 11:19:33.746836 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 11:19:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:36.148350 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-e7f9b29e-d97d-47cf-904c-48d74d5394fa admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:36.150036 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-e7f9b29e-d97d-47cf-904c-48d74d5394fa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002764 Aug 24 11:19:36.150900 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:36.679949 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-85c34d7c-4ea7-4542-b123-fa003f3212d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:36.688429 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:36.703679 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-85c34d7c-4ea7-4542-b123-fa003f3212d9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.546744 Aug 24 11:19:36.704430 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Aug 24 11:19:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:19:36.719314 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-98bba39f-6444-4168-813b-d8bcc1a48deb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:36.743916 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-98bba39f-6444-4168-813b-d8bcc1a48deb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030654 Aug 24 11:19:36.744506 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Aug 24 11:19:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:55.912176 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-85c34d7c-4ea7-4542-b123-fa003f3212d9 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:55.913192 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-85c34d7c-4ea7-4542-b123-fa003f3212d9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 11:19:55.913613 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:55.920872 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:56.323346 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-46d929cd-b7b9-4ba1-b234-749166eda60f admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:56.342447 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-46d929cd-b7b9-4ba1-b234-749166eda60f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.422336 Aug 24 11:19:56.342992 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 11:19:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:57.417042 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-85c34d7c-4ea7-4542-b123-fa003f3212d9 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:57.418081 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-85c34d7c-4ea7-4542-b123-fa003f3212d9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 11:19:57.418492 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:57.939956 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-2c6dcdd1-cd7f-4ce6-84ec-c02c599309ac admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:57.945609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.wsgi [None req-2c6dcdd1-cd7f-4ce6-84ec-c02c599309ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-2c6dcdd1-cd7f-4ce6-84ec-c02c599309ac admin admin] Request method failure captured: Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Accept: application/json Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Accept-Encoding: gzip, deflate Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Connection: keep-alive Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Content-Length: 0 Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Host: 10.222.0.17 Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Openstack-Api-Version: compute 2.90 Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Openstack-System-Scope: None Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: User-Agent: python-novaclient Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Auth-Token: gAAAAABjBglduGQvw4omzK_3kjm78b5jZ12WdcgNdZ5mlm67YTR1CHoGgBBGlO4_C2Q_BtrAduGmI94Bbny69aMcJDKICLXMPVAY-dvZbGmJvWFcVRDEH5-8XQ2LWjHsds8coRtipcefGLKxymEgWiUfzYFJQRzY--Fz_yGcCMQreT8EaaUhKLA Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Domain-Id: None Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Domain-Name: None Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Identity-Status: Confirmed Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Is-Admin-Project: True Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Domain-Id: default Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Domain-Name: Default Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Name: admin Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Role: reader,member,admin Aug 24 11:19:57.948981 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Roles: reader,member,admin Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_547f8ee10967428da52e1ba471490be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/547f8ee10967428da52e1ba471490be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant: admin Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant-Name: admin Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User: admin Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Domain-Id: default Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Domain-Name: Default Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Id: 8fc61334c85d43c98df13a441454d726 Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Name: admin Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: method: > Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: exception: Flavor 42 could not be found. Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: action_args: {'id': '42'} Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:19:57.950534 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:57.951414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:57.952741 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-2c6dcdd1-cd7f-4ce6-84ec-c02c599309ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:19:57.954092 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-2c6dcdd1-cd7f-4ce6-84ec-c02c599309ac admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393098 Aug 24 11:19:57.954092 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 11:19:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:19:57.960015 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-49fd4044-d017-47d3-8fcf-16ce5803f4d5 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:57.984682 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-49fd4044-d017-47d3-8fcf-16ce5803f4d5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028142 Aug 24 11:19:57.985252 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 11:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:19:57.996004 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-6869f963-422e-41f1-97f4-5bf8dd2bbea1 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:58.019787 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-6869f963-422e-41f1-97f4-5bf8dd2bbea1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028235 Aug 24 11:19:58.020331 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 11:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:58.031413 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-33e03d25-536c-478e-8ed5-457be0db5460 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:58.037002 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.wsgi [None req-33e03d25-536c-478e-8ed5-457be0db5460 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-33e03d25-536c-478e-8ed5-457be0db5460 admin admin] Request method failure captured: Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Accept: application/json Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Accept-Encoding: gzip, deflate Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Connection: keep-alive Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Content-Length: 0 Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Host: 10.222.0.17 Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Openstack-Api-Version: compute 2.90 Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Openstack-System-Scope: None Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: User-Agent: python-novaclient Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Auth-Token: gAAAAABjBglduGQvw4omzK_3kjm78b5jZ12WdcgNdZ5mlm67YTR1CHoGgBBGlO4_C2Q_BtrAduGmI94Bbny69aMcJDKICLXMPVAY-dvZbGmJvWFcVRDEH5-8XQ2LWjHsds8coRtipcefGLKxymEgWiUfzYFJQRzY--Fz_yGcCMQreT8EaaUhKLA Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Domain-Id: None Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Domain-Name: None Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Identity-Status: Confirmed Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Is-Admin-Project: True Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Domain-Id: default Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Domain-Name: Default Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Name: admin Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Role: reader,member,admin Aug 24 11:19:58.041013 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Roles: reader,member,admin Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_547f8ee10967428da52e1ba471490be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/547f8ee10967428da52e1ba471490be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant: admin Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant-Name: admin Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User: admin Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Domain-Id: default Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Domain-Name: Default Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Id: 8fc61334c85d43c98df13a441454d726 Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Name: admin Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: method: > Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: exception: Flavor 42 could not be found. Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: action_args: {'id': '42'} Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:19:58.042529 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:58.043421 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:58.044449 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-33e03d25-536c-478e-8ed5-457be0db5460 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:19:58.045473 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-33e03d25-536c-478e-8ed5-457be0db5460 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015546 Aug 24 11:19:58.045473 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 11:19:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:19:59.029325 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-6869f963-422e-41f1-97f4-5bf8dd2bbea1 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:59.030345 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-6869f963-422e-41f1-97f4-5bf8dd2bbea1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 11:19:59.030740 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:59.558797 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-37bea523-a4c6-4dad-ae81-e77e2279ddd7 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:59.566221 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.wsgi [None req-37bea523-a4c6-4dad-ae81-e77e2279ddd7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-37bea523-a4c6-4dad-ae81-e77e2279ddd7 admin admin] Request method failure captured: Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Accept: application/json Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Accept-Encoding: gzip, deflate Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Connection: keep-alive Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Content-Length: 0 Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Host: 10.222.0.17 Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Openstack-Api-Version: compute 2.90 Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Openstack-System-Scope: None Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: User-Agent: python-novaclient Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Auth-Token: gAAAAABjBgleboxC1PK2v8mvOqk_MJdGfL3yFNlwgPFPpitmkGVmBdoFARRm8lndbX0bt61Fz5udKx_F14CvkjekAI3sZEfMTPhJXfxGEl6bxfjnhsmV-17mz8L1AbQZoOeOBDfHfcriWnS-1DBVYatskjzR4cJVMJ_KPNNEvxoZLoNekipJkuQ Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Domain-Id: None Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Domain-Name: None Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Identity-Status: Confirmed Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Is-Admin-Project: True Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Domain-Id: default Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Domain-Name: Default Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Name: admin Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Role: reader,member,admin Aug 24 11:19:59.567730 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Roles: reader,member,admin Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_547f8ee10967428da52e1ba471490be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/547f8ee10967428da52e1ba471490be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant: admin Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant-Name: admin Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User: admin Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Domain-Id: default Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Domain-Name: Default Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Id: 8fc61334c85d43c98df13a441454d726 Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Name: admin Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: method: > Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: exception: Flavor 84 could not be found. Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: action_args: {'id': '84'} Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:19:59.569238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:59.570207 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.571506 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-37bea523-a4c6-4dad-ae81-e77e2279ddd7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:19:59.572855 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-37bea523-a4c6-4dad-ae81-e77e2279ddd7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399094 Aug 24 11:19:59.572855 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 11:19:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:19:59.579072 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-c19928e9-ef99-437e-850d-d2391710d397 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:59.595139 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-c19928e9-ef99-437e-850d-d2391710d397 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019671 Aug 24 11:19:59.595704 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 11:19:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:59.606602 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-d05c4076-3ad4-461f-a27a-158ad677717d admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:59.621771 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-d05c4076-3ad4-461f-a27a-158ad677717d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019948 Aug 24 11:19:59.622312 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 11:19:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:59.631781 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-3eef0a8b-1740-4d45-a389-b6136018bb62 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:59.637480 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.wsgi [None req-3eef0a8b-1740-4d45-a389-b6136018bb62 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-3eef0a8b-1740-4d45-a389-b6136018bb62 admin admin] Request method failure captured: Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Accept: application/json Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Accept-Encoding: gzip, deflate Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Connection: keep-alive Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Content-Length: 0 Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Host: 10.222.0.17 Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Openstack-Api-Version: compute 2.90 Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Openstack-System-Scope: None Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: User-Agent: python-novaclient Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Auth-Token: gAAAAABjBgleboxC1PK2v8mvOqk_MJdGfL3yFNlwgPFPpitmkGVmBdoFARRm8lndbX0bt61Fz5udKx_F14CvkjekAI3sZEfMTPhJXfxGEl6bxfjnhsmV-17mz8L1AbQZoOeOBDfHfcriWnS-1DBVYatskjzR4cJVMJ_KPNNEvxoZLoNekipJkuQ Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Domain-Id: None Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Domain-Name: None Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Identity-Status: Confirmed Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Is-Admin-Project: True Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Domain-Id: default Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Domain-Name: Default Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Name: admin Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Role: reader,member,admin Aug 24 11:19:59.638959 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Roles: reader,member,admin Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_547f8ee10967428da52e1ba471490be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/547f8ee10967428da52e1ba471490be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant: admin Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant-Name: admin Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User: admin Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Domain-Id: default Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Domain-Name: Default Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Id: 8fc61334c85d43c98df13a441454d726 Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Name: admin Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: method: > Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: exception: Flavor 84 could not be found. Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: action_args: {'id': '84'} Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:19:59.640414 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:59.641296 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:19:59.642601 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-3eef0a8b-1740-4d45-a389-b6136018bb62 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:19:59.643684 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-3eef0a8b-1740-4d45-a389-b6136018bb62 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012097 Aug 24 11:19:59.643684 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 24 11:19:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:20:00.635609 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-d05c4076-3ad4-461f-a27a-158ad677717d admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:00.636636 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-d05c4076-3ad4-461f-a27a-158ad677717d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 11:20:00.637040 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:20:01.207095 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-7025b401-8079-4619-8dbf-5abee4e2828f admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:01.214478 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.wsgi [None req-7025b401-8079-4619-8dbf-5abee4e2828f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-7025b401-8079-4619-8dbf-5abee4e2828f admin admin] Request method failure captured: Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Accept: application/json Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Accept-Encoding: gzip, deflate Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Connection: keep-alive Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Content-Length: 0 Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Host: 10.222.0.17 Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Openstack-Api-Version: compute 2.90 Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Openstack-System-Scope: None Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: User-Agent: python-novaclient Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Auth-Token: gAAAAABjBglgiI1yY3UKk6lfBYSjnFc47RElPnY1BV-ute8IIpX3rsInuCrblZLrDCzcURVt46rzr1i_xax7V3ogvm7PeciF0FUZW7UZseix-yYVetED3429nqS-71RLfMPKDfXu1Cgd8mWeLjPtZVWRA5UHstPEcgbjt6QAoQ-v53sfZ2FwUMw Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Domain-Id: None Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Domain-Name: None Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Identity-Status: Confirmed Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Is-Admin-Project: True Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Domain-Id: default Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Domain-Name: Default Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Project-Name: admin Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Role: reader,member,admin Aug 24 11:20:01.216007 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Roles: reader,member,admin Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_547f8ee10967428da52e1ba471490be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/547f8ee10967428da52e1ba471490be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant: admin Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-Tenant-Name: admin Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User: admin Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Domain-Id: default Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Domain-Name: Default Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Id: 8fc61334c85d43c98df13a441454d726 Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: X-User-Name: admin Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: method: > Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: exception: Flavor 451 could not be found. Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: action_args: {'id': '451'} Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:20:01.217609 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:20:01.218645 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.219988 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-7025b401-8079-4619-8dbf-5abee4e2828f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:20:01.221219 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-7025b401-8079-4619-8dbf-5abee4e2828f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.437848 Aug 24 11:20:01.221219 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 11:20:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:20:01.227324 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-dc2ecb4d-af7a-4a10-8e06-d3479bdfbd9c admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:01.254238 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-dc2ecb4d-af7a-4a10-8e06-d3479bdfbd9c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030334 Aug 24 11:20:01.254810 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 11:20:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:20:01.265526 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:01.281496 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019534 Aug 24 11:20:01.282065 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 24 11:20:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:20:01.292699 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-1ceab803-e76a-47a7-a2d8-31b73587f19a admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:01.298223 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.wsgi [None req-1ceab803-e76a-47a7-a2d8-31b73587f19a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-1ceab803-e76a-47a7-a2d8-31b73587f19a admin admin] Request method failure captured: Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Accept: application/json Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Accept-Encoding: gzip, deflate Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Connection: keep-alive Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Content-Length: 0 Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Host: 10.222.0.17 Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Openstack-Api-Version: compute 2.90 Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Openstack-System-Scope: None Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: User-Agent: python-novaclient Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Auth-Token: gAAAAABjBglgiI1yY3UKk6lfBYSjnFc47RElPnY1BV-ute8IIpX3rsInuCrblZLrDCzcURVt46rzr1i_xax7V3ogvm7PeciF0FUZW7UZseix-yYVetED3429nqS-71RLfMPKDfXu1Cgd8mWeLjPtZVWRA5UHstPEcgbjt6QAoQ-v53sfZ2FwUMw Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Domain-Id: None Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Domain-Name: None Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Identity-Status: Confirmed Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Is-Admin-Project: True Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Domain-Id: default Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Domain-Name: Default Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Project-Name: admin Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Role: reader,member,admin Aug 24 11:20:01.299731 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Roles: reader,member,admin Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_547f8ee10967428da52e1ba471490be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/547f8ee10967428da52e1ba471490be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/547f8ee10967428da52e1ba471490be8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant: admin Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant-Id: 547f8ee10967428da52e1ba471490be8 Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-Tenant-Name: admin Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User: admin Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Domain-Id: default Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Domain-Name: Default Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Id: 8fc61334c85d43c98df13a441454d726 Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: X-User-Name: admin Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: method: > Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: exception: Flavor 451 could not be found. Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: action_args: {'id': '451'} Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:20:01.301242 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:20:01.302147 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 24 11:20:01.303482 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-1ceab803-e76a-47a7-a2d8-31b73587f19a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:20:01.304646 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-1ceab803-e76a-47a7-a2d8-31b73587f19a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012888 Aug 24 11:20:01.304646 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 11:20:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:20:02.302319 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:02.303329 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 11:20:02.303721 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:02.837858 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-0ce86e81-2460-4293-b236-4b58077f91f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:02.861351 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-0ce86e81-2460-4293-b236-4b58077f91f0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.418585 Aug 24 11:20:02.861933 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 11:20:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:20:03.847233 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:03.848252 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 24 11:20:03.848657 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:04.381945 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-f779ab38-3dda-431f-ab4d-93f77891260b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:04.401563 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-f779ab38-3dda-431f-ab4d-93f77891260b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.410999 Aug 24 11:20:04.402101 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 11:20:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:20:05.385490 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:05.386504 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Aug 24 11:20:05.386905 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:05.939556 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-314ecf4f-1f93-44d0-9c00-28aed7ddfe0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:05.960547 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-314ecf4f-1f93-44d0-9c00-28aed7ddfe0b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.433824 Aug 24 11:20:05.961098 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 11:20:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:20:06.940220 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:06.941243 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 11:20:06.941643 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:07.474172 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-7627ba69-0d7f-4631-ac8a-f2f00f0710ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:07.492854 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-7627ba69-0d7f-4631-ac8a-f2f00f0710ca admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413574 Aug 24 11:20:07.493441 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 24 11:20:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:20:08.468456 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:08.469505 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 11:20:08.469902 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:09.008794 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-e20696d4-6b82-4a82-9dac-0055c24c11d2 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:09.030029 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-e20696d4-6b82-4a82-9dac-0055c24c11d2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.422494 Aug 24 11:20:09.030565 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Aug 24 11:20:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:21:04.983084 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:04.984098 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-cf7a0c28-b65d-4eb8-add2-b4c52631a2b6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 11:21:04.984501 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Wed Aug 24 11:21:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:04.995360 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:05.390004 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-f0c90c1d-c704-483a-86b2-9e7f10ca596d admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:05.411716 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-f0c90c1d-c704-483a-86b2-9e7f10ca596d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420706 Aug 24 11:21:05.412281 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Aug 24 11:21:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:21:05.434299 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=14 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:05.438393 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-de3795a6-f0d6-484c-bf3e-ea62a190e422 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:05.446288 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-de3795a6-f0d6-484c-bf3e-ea62a190e422 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013575 Aug 24 11:21:05.446823 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Aug 24 11:21:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:21:05.463212 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-0bd89330-f420-4b2e-9a5e-8d02d95ea61c admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:05.471581 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-0bd89330-f420-4b2e-9a5e-8d02d95ea61c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011990 Aug 24 11:21:05.472100 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Aug 24 11:21:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:05.484364 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:05.492275 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012321 Aug 24 11:21:05.492759 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Aug 24 11:21:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:05.504828 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-27c205ec-d707-4511-8496-028f833b2330 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:05.512454 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-27c205ec-d707-4511-8496-028f833b2330 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011182 Aug 24 11:21:05.513498 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Aug 24 11:21:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:08.345220 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:08.346259 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 24 11:24:08.346655 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:08.491156 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=6 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:08.666099 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:08.668456 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:08.668456 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: warnings.warn(msg) Aug 24 11:24:08.669614 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:08.670092 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:08.670524 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:08.671269 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:08.671716 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:08.672132 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:08.706152 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-eea49bc0-9c3b-45d0-8794-31835a858b16 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216555 Aug 24 11:24:08.706721 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 11:24:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:24:09.559488 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:09.560975 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002725 Aug 24 11:24:09.561438 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:24:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:09.760968 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:09.763336 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:09.763336 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: warnings.warn(msg) Aug 24 11:24:09.764475 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:09.764965 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:09.765442 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:09.766175 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:09.766626 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:09.767052 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:09.788155 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-9bb67294-a4c6-44d9-95ab-e149e6a8bd56 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083302 Aug 24 11:24:09.788796 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 11:24:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:24:21.132095 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:21.133116 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Aug 24 11:24:21.133812 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:21.302012 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell0:SELECT=4 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:21.303101 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell1:SELECT=4 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:21.304339 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=8 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:21.367920 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:21.370407 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:21.370407 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: warnings.warn(msg) Aug 24 11:24:21.371526 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:21.372010 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:21.372451 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:21.373173 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:21.373656 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:21.374074 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:21.402685 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-f917b74c-43a6-4c70-98f6-89332dfc84f1 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.109522 Aug 24 11:24:21.403317 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 11:24:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:24:22.292073 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:22.293788 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-67626346-5253-4d0c-8bf5-0517ea29a629 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 24 11:24:22.294656 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 24 11:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:22.496267 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:22.498913 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:24:22.498913 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: warnings.warn(msg) Aug 24 11:24:22.500014 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:22.500521 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:22.500945 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:22.501761 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:22.502209 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:22.502626 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:22.526524 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-f5e61937-a9ef-4458-acfc-9bd0b83c5098 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089628 Aug 24 11:24:22.527100 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 24 11:24:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:25:19.144045 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: Wed Aug 24 11:25:19 2022 - graceful shutdown triggered... Aug 24 11:25:19.143952 dv-cinder-854275-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 11:25:19.145142 dv-cinder-854275-3-iscsi devstack@n-api.service[105468]: Gracefully killing worker 2 (pid: 105468)... Aug 24 11:25:19.145974 dv-cinder-854275-3-iscsi devstack@n-api.service[105467]: Gracefully killing worker 1 (pid: 105467)... Aug 24 11:25:20.144972 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: worker 1 buried after 1 seconds Aug 24 11:25:20.145587 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: worker 2 buried after 1 seconds Aug 24 11:25:20.145587 dv-cinder-854275-3-iscsi devstack@n-api.service[105466]: goodbye to uWSGI. Aug 24 11:25:20.146602 dv-cinder-854275-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 11:25:20.147171 dv-cinder-854275-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 11:25:20.150118 dv-cinder-854275-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:25:20.159769 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:25:20 2022] *** Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: nodename: dv-cinder-854275-3-iscsi Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: machine: x86_64 Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: clock source: unix Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: pcre jit disabled Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: detected number of CPU cores: 4 Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: current working directory: / Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:25:20.161837 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: your processes number limit is 47680 Aug 24 11:25:20.162683 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: your memory page size is 4096 bytes Aug 24 11:25:20.162683 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: detected max file descriptor number: 2048 Aug 24 11:25:20.162683 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: lock engine: pthread robust mutexes Aug 24 11:25:20.162683 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: thunder lock: enabled Aug 24 11:25:20.162683 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:25:20.162683 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:25:20.203671 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: Python main interpreter initialized at 0x556a47e199c0 Aug 24 11:25:20.203671 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: python threads support enabled Aug 24 11:25:20.203671 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: your server socket listen backlog is limited to 100 connections Aug 24 11:25:20.203671 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:25:20.204157 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:25:20.204157 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: *** Operational MODE: preforking *** Aug 24 11:25:20.204414 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:25:20.204414 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: spawned uWSGI master process (pid: 120709) Aug 24 11:25:20.204620 dv-cinder-854275-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:25:20.205191 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: spawned uWSGI worker 1 (pid: 120720, cores: 1) Aug 24 11:25:20.206912 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: spawned uWSGI worker 2 (pid: 120722, cores: 1) Aug 24 11:25:20.207027 dv-cinder-854275-3-iscsi devstack@n-api.service[120709]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:25:20.877675 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:25:20.893053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:25:22.066054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:25:22.066054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Aug 24 11:25:22.066716 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:25:22.066716 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Aug 24 11:25:22.077906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:25:22.077906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: from cryptography.utils import int_from_bytes Aug 24 11:25:22.078462 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:25:22.078462 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: from cryptography.utils import int_from_bytes Aug 24 11:25:24.525217 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:25:24.525811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:25:24.526083 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:25:24.526459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:25:24.526721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:25:24.527257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.527454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.527794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.528122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.528610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.528934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.529292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.529626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.529966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.530231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.530554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.530887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-3-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.531221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.531535 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.531854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.532180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.532433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:25:24.532826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.532922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:25:24.533013 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.533103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.533227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:25:24.533613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:25:24.533731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.533886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:25:24.534087 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.534257 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.534407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.534590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.534726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.534922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.535096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.535247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.535384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.535706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.535817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.536029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.536130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.536355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.536497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.536673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.536849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-3-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537759 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.537924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854275-3-iscsi {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.538062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.538258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.538385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.538573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.538754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.538879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.539074 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.539236 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.539626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.539755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.540202 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.540322 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.540523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.540643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.540863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.541051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.541222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.541459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.541588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.541706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.541863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.542022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.542192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.542369 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.542500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.542693 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.542824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543135 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543780 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.543988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.544106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.544270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.544400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.544579 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.544706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854275-3-iscsi {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.544917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.545066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.545246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.545390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.545584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.545758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.546071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.546280 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.546491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.546704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.546912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547656 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.547918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548105 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548288 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548511 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.548948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.549145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.549317 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.549502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.549672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.549828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.549926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550158 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550319 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550613 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550852 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.550990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.551186 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.551309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.551443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.551647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.551769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.551977 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.552098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.552327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.552769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.552877 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.552972 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553471 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.553953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554265 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554693 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.554992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.555331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.555516 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.555667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.555969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.556077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.556289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.556377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.556608 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.556746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.556931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.557061 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.557276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.557417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.557594 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.557730 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.557925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558303 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558396 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558897 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.558989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.559231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.559333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.559546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.559637 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.559861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.559962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.560174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.560263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.560487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.560579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.560799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.560900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.561113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.561252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.561453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.561563 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.561779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.561880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562653 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562780 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.562956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.563063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.563272 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.563362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.563598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.563694 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.563912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.564940 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.565165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.565299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.565504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.565602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.565817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.565905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.566131 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.566231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.566436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.566534 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.566745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.566841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.567987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.568086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.568299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.568416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.568608 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.568699 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.568919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569664 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569870 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.569961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.570192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.570293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.571019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.571187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.571347 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.571499 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.571662 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.571976 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.572077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.572300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.572400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.572614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.572742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.572927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.573046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.573290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.573418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.573733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.573865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.573976 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.574085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.574229 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.574357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.574545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.574671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.574859 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.574997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.575174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.575356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.575500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.575659 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.575815 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.575973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.576110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.576268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.576444 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.576573 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.576755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.576883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.577066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.577294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.577475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.577811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.578081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.578255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.578444 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.578621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.580599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.580759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.580871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.580968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.581053 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.581193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.582651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.582834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:25:24.583042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.583267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.583454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.583644 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.583852 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.583852 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.584231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.584403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.584564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.584711 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.584847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.584999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585216 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585710 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.585960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.586051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.586777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.586938 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.587877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.588944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.589264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.589402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.589609 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.589752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.589928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.590173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.590263 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.590545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.590725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.590876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.591939 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.592126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.592268 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.592475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.592607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.592795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.592946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.593105 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.593281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.593453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.593596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.593753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.593904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.594076 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.594276 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.594423 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.594564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.594722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.594869 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.595953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.596112 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.596268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.596417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.596590 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.596736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.596837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.597085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.597288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.597490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.597698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.597850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.597984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.598129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.598255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.598402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.598607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599743 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599743 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.599953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600285 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600689 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.600911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.601059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.601336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.601454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.601582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.601679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.601935 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.602054 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.602278 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.602444 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.602597 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.602952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.603116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.603275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.603441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.603599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.603933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604216 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.604812 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.605017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.605116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.605373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.605468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.605695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.605786 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606109 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.606964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.607062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.607289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.607384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.607607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.607753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.607928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608571 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.608995 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.609244 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.609358 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.609572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.609787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.609902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610000 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610201 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610525 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610628 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.610945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.611178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.611330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.611501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.611604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.611821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.611986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.612131 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.612279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.612432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.612661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.612756 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.612890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613027 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613541 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613683 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.613997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.614139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.614300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.614444 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.614635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.614820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.614984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.615950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.616204 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.616297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.616522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.616712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.616854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.617175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.617282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.617637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.618045 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.618184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.618449 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.618686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.618892 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.619032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.619234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.619365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.619576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.619730 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.619911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620245 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620382 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.620988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.622409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.622596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.622596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.622850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.622850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623424 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.623973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.624122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.624273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.624424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.624620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.624620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.624904 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.625037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.625194 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.625420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.625629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.625629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.625944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626216 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626660 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.626988 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.627162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.627327 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.627498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.627649 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.627739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.627925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.628029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.628239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.628337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.628566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.628646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.628887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.629055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.629275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.629426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.629649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.629802 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.629970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.630157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.630355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.630553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.630705 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.630862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.631022 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.631171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.631328 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.631502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.632225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.632643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.632903 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.633669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.633901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.634053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.634212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.634408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.634615 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.634801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.634990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.635172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.635172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.635457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.635601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.635741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.635865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.636007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.636195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.636195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.636537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.636788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.637037 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.637328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.637577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.637728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.637947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638082 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638834 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.638961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.639149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.639346 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.639668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.639814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640130 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640825 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.640918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.641072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.641171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.641337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.641469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.641635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.641750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642370 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642628 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642713 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.642912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643571 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643654 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.643997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.644134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.644316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.644423 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.644651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.644741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.644975 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.645066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.645455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.645577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.645654 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.645796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.645949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646422 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.646993 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.647219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.647317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.647534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.647621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.647847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.647944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.648158 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.648254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.648724 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.649642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.649642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650422 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.650916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.651081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.651889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.652120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.652258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.652648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.652762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.652871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.652979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.653432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.653560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.653687 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.653798 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.653921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654347 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.654947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.655256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.655385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.655508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.655508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.655508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.655935 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.656836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657148 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657311 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657869 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.657963 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.658048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.658295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.658396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.658616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.658706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.658946 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659045 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659348 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659719 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659869 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.659968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.660178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.660318 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.660494 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.660621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.660871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.661259 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.661467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.661599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.661852 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.661979 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.662211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.662334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.662852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.663996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.664116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.664256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.665117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.665390 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.665665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.665981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.666248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.666718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.666862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.667228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.667364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.667802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.667950 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.668089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.668471 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.668670 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.668846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.669043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.669303 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.669528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.669710 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.669860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.670107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.670241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.670446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.670664 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.670842 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.671040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.671283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.671506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.671717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.671853 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.672020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.672217 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.673518 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.673747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.673942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.674137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.674351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.674559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.674757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.674962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.675168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.675403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.675614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.675820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.676014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.676220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.676428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.676620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.676834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.677039 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.677324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.677519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.677713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.677934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.678147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.678340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.678533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.678533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.678921 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.679090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.679248 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.679439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.679572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.679701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.679864 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.680534 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.680676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.680805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.680934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.681134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.681360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.681592 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.681814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.682015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.682015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.682015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.682620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.682938 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.683269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.683719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.683934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684076 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684201 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684441 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684785 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.684977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.685287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.685489 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.685677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.685901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.686113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.686309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.686448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.686586 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.686740 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.686868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.687930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.688077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.688228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.688376 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.688577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.688748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.688899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.689041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.689212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.689212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.689510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.689705 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.690000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.690173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.690379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.690572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.690767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.690970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.691161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.691325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.691539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.691691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.691886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.692095 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.692325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.692547 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.692763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.693191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.693191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.694196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.694441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.694657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.694882 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.695107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.695328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.696618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.697909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.698165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.698399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.698635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.698909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.699162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.699415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.699647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.699885 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.700129 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.700357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.700556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.700801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.701043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.701314 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.701314 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.701766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.702007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.702235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.702463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.702694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.702925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.703174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.703472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.703472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.703472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.704577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.704577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.705359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.705359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.705771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.705994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.705994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.706426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.706764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.706764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.707166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.707378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.707601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.707848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.708073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.708284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.708284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.708680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.708900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.708900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.709352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.709523 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.709523 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.709792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.709943 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.710157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.710351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.710502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.710651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.710801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.711036 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.711804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.712034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.712034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.712520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.712767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.713011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.713175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.713435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.713587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.713730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.714021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.714310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.714582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.714737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.714737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.715923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.716065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.716213 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.716362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.716569 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.716949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.717193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.717193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.717572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.717717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.717717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.718008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.718176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.718327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.718479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.718690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.718914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.719150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.719374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.719598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.719832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.720070 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.720291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.720535 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.720769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.720929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.721072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.721242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.721478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.721633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.721786 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.721928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.722962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723544 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.723838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.724315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.724315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.724315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.724962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.725124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.725331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.725479 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.725628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.725778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.725922 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.726069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.726224 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.726366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.726507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.726648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.727341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.727628 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.727788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.727948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.728145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.728301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.728489 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.728650 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.728801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.728951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.729094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.729279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.729428 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.729583 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.729737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.729902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730785 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730927 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.730927 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.731193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.731343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.731484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.731484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.731770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.731918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732214 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.732942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.733084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.733292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.733452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.733604 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.733754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.733905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.734046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.734194 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.734449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.734708 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.734708 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.735123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.735274 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.735425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.735573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.735729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.735885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736183 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736617 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.736918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.737106 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.737284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.737432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.737593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.737858 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738454 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.738895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739774 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.739924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.740930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.741070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.741241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.741403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.741563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.741721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.741871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.742012 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.742175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.742317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.742530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.743180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.743383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.743545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.743688 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.743838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.743987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.744140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.744283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.744493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.744942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.745268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.745423 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.745578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.745578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.745868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746060 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746662 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746808 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.746951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.747100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.747241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.747391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.747542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.747690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.747866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.748132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.748282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.748435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.748586 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.748729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.748878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.749916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.750786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.751072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.751215 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.751215 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.751501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.751731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752606 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.752904 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.753058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.753245 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.753633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.753633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.753921 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.755028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.755335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.755494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.755650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.755809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.755961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.756111 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.756255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.756466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.756688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.756846 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.757045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.757219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.757650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.757797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.758000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.758774 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.758974 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.759189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.759367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.759520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.759686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.759908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.760068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.760212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.760354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.760495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.760695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.760947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.761100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.761330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.761330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.761330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.761764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.761929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.762079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.762227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.762379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.762520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.762684 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.762839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763327 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.763905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764195 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764195 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.764944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.765336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.765336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.765336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.765336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766149 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766600 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766740 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.766900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767483 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767483 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.767758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.768034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.768189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.768332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.768472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.768626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.768795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769948 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.769948 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.770373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.770597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.770597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.771036 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.771217 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.771371 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.771515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.771656 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.771807 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.772004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.772228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.772401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.772554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.772695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.772868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.773077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.773320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.773513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.774405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.775039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.775603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.776001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.776386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.776558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.776799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.777090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.777346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.777591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.777591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.778048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.778287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.778524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.778771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779304 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779916 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.779916 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.780200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.780344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.780486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.780647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.780811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.781036 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.781192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.781367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.781517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.781677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.781848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.782924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.783080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.783228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.783228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.783561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.783748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.784006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.784174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.784333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.784538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.784695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.784866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.785034 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.785296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.785488 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.785906 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.786169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.786340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.786340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.786623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.786623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.786905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.787052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.787212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.787374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.787521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.787521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.787810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.788041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.788193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.788193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.788482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.788482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.789073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.789306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.789576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.789752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.789903 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.790799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.791081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.791238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.791387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.791543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.791543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.791845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.792894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.793044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.793191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.793446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.793611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.793768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.793929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.794845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.796212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.796462 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.796616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.796778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.796778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.797058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.797058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.797378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.797541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.797708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.797857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798012 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798159 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798477 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.798932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.799106 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.799264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.799421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.799607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.799843 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.799996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.800144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.800300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.800450 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.800598 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.800598 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.800883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.801030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.801190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.801377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.801534 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.801700 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.801856 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802605 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.802916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803673 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803834 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.803989 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.804145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.804301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.804449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.804612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.804840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.805006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.805342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.805583 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.807260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.807459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.807626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.807778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.807926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.808074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.808222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.808384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.808541 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.808701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.808906 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.809128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.809128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.809453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.809616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.809764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.810937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.811092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.811240 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.811397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.811553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.811713 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.811860 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812467 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812467 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.812893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813217 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.813986 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.814138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.814138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.814416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.814416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.814696 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.814857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815006 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815318 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815318 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.815921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.816094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.816394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.816394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.816792 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.816948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.817097 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.817263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.817430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.817593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.817753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.817909 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.818064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.818215 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.818363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.818548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.818548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.818849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.819057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.819220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.819433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.819669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.819868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.820039 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.820317 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.821033 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.821191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.821641 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.821800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.822171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.822401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.822635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.822844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.823015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.823220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.823445 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.823679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.823920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.824167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.824404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.824651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.824887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.825125 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.825379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.825635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.825872 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.826110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.826658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.827568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.829327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.831281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.831281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.831281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.831281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:25:24.831281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:25:24.887087 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Registered counter for database nova_api Aug 24 11:25:24.894470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO dbcounter [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Registered counter for database nova_api Aug 24 11:25:24.911518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:24.917026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:24.922170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:24.924378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:24.984714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.context [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c(cell1) {{(pid=120720) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:25:24.987847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.context [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c(cell1) {{(pid=120722) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:25:24.988842 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.989343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.991267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.991977 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.992133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.992473 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.992643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.994493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.994838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.995267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.995724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.996976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Registered counter for database nova_cell0 Aug 24 11:25:24.997805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.000031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO dbcounter [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Registered counter for database nova_cell0 Aug 24 11:25:25.001178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Registered counter for database nova_cell1 Aug 24 11:25:25.004497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO dbcounter [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Registered counter for database nova_cell1 Aug 24 11:25:25.009055 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:25.012963 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:25.014492 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:25.017545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:25.019018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:25.020685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:25.167593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:25.177500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Registered counter for database nova_cell0 Aug 24 11:25:25.185456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:25.190488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:25.209964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:25.220693 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO dbcounter [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Registered counter for database nova_cell0 Aug 24 11:25:25.231409 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_db.sqlalchemy.engines [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:25:25.236731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writer thread running {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:25:25.523254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:25:25.531591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:25:25.592359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:25:25.600536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:25:25.889183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:25:25.895939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-94ac9fb2-a48b-46ae-ae90-97e057779014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:25:25.901809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a47e199c0 pid: 120720 (default app) Aug 24 11:25:25.971765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:25:25.979247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: WARNING keystonemiddleware.auth_token [None req-01493906-70a3-413c-8e41-c8fd65690f8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:25:25.984839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a47e199c0 pid: 120722 (default app) Aug 24 11:26:17.860949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:17.861682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:17.862490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:17.863208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:19.274309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1314562904", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "networks": [{"uuid": "0e591aa7-5efa-4e26-bde4-04bce9d97869"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:20.421190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] validate_networks() for [('0e591aa7-5efa-4e26-bde4-04bce9d97869', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:22.119348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:22.124691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:22.125731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:22.131442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.463437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a623b89-2279-4b5d-b8cc-aa05f379fa80 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: .version_select at 0x7f5ba66f15e0>, body: {"keypair": {"name": "tempest-keypair-245543157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdeWPNObpVFHJfapn58Wc6d6n4UwdW2hid+sbbGacBxiZADr+y5X58twIhyKn/Oc9j/zuiYVoaGNe4z5d6TpW7Yrr01ob0QL/N0RaY1uPDhOnjL6kngExVA982jEtI/dA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:23.606301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-0a623b89-2279-4b5d-b8cc-aa05f379fa80 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:23.626807 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-0a623b89-2279-4b5d-b8cc-aa05f379fa80 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:23.778116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a623b89-2279-4b5d-b8cc-aa05f379fa80 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.671186 Aug 24 11:26:23.780293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:26:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:24.420045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:24.420500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:24.420990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:24.421429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:24.421979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:24.461180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:24.461900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:24.462788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:24.463754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:24.464816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:24.465466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:24.526450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Getting quotas for project 1966dbb1de9c42c2a765c655104e7231. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:24.537537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Getting quotas for user 640a850f8a7d461aa7bfed45d14e41e0 and project 1966dbb1de9c42c2a765c655104e7231. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:24.557173 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:24.561282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:24.709628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9aa722b0-ec3b-4d1c-8631-8d2101a1714f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.853755 Aug 24 11:26:24.710591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 6857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:24.724910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-29c56b99-ca25-4df4-b842-0ed948a56a7a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:24.725831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-29c56b99-ca25-4df4-b842-0ed948a56a7a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:26.557274 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-29c56b99-ca25-4df4-b842-0ed948a56a7a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:26.578103 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-29c56b99-ca25-4df4-b842-0ed948a56a7a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1215 microversion: 2.1 time: 1.858039 Aug 24 11:26:26.579428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:24 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1215 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:27.208910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12536a6f-e299-42fc-9373-c0a6c56612d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'create', calling method: .version_select at 0x7f5ba5d00430>, body: {"keypair": {"name": "tempest-keypair-2079084680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUqQPw6+fPRHfunec0Mh2RWDSI1GQVSfze7TSbbIsxSuxTTZ1nsR4gE6i5V88st5ZqQgqRB3bzjkzKhEUzVNBnHBlCocQQaM7JUn+oJ9aK+y0E99YbeqliUCeISBfklcg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:27.274405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-649139203", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:27.342481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-12536a6f-e299-42fc-9373-c0a6c56612d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:27.364805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-12536a6f-e299-42fc-9373-c0a6c56612d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for user 6a2bfeaa15ee4ef3bcaa21e22c71895d and project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:27.473706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12536a6f-e299-42fc-9373-c0a6c56612d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.812387 Aug 24 11:26:27.477180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] validate_networks() for [('c70bafd0-5a35-4f61-9bc3-c5b84adfc134', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:27.477415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2/4] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Aug 24 11:26:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 822 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:26:27.602179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:27.602674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:27.644620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:27.645117 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:27.645661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:27.646379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:27.657331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:27.657889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:28.177319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:28.240726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79768c0e-2900-486c-b915-c4a30da1ac47 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1267 microversion: 2.1 time: 0.644101 Aug 24 11:26:28.266140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:27 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1267 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:29.191013 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-714071298", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f827975f-fb9d-4fba-ac33-57f23df4fae0"}], "security_groups": [{"name": "tempest-securitygroup--391352345"}], "key_name": "tempest-keypair-245543157", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:29.604047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] validate_networks() for [('f827975f-fb9d-4fba-ac33-57f23df4fae0', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:31.656505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:31.659553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:31.660411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:31.661069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:31.661905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:31.692556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:31.694248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:31.696122 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:31.699403 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:31.707889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:31.709760 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:31.783326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:31.791404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for user 6f7224ed18ba423084846da68a920f52 and project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:31.811857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:31.816281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:31.934723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00441f1f-559e-4e17-8863-b4ad6caa82dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.151262 Aug 24 11:26:31.946060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 3/6] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 5163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:31.947165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:31.949107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:31.949769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:31.950486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:31.951038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:31.968989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:31.969930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:31.972107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:31.975124 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:31.976458 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:31.979189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:31.980362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:31.983113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:32.019472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:32.020896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:32.021485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:32.022332 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:32.022836 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:32.026993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:32.032845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:32.035295 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:32.073466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:32.075934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:32.187051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-196383c6-2369-42d9-bd6b-e73b187f3262 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.000624 Aug 24 11:26:32.200006 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4/7] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:32.207296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5cf7c84-e496-4960-a10f-1bb68667b07f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:32.208274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5cf7c84-e496-4960-a10f-1bb68667b07f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:32.386902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5cf7c84-e496-4960-a10f-1bb68667b07f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:32.407092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5cf7c84-e496-4960-a10f-1bb68667b07f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1221 microversion: 2.1 time: 0.205678 Aug 24 11:26:32.414740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:32 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:32.438464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7a198bb-6a8f-45ca-b3f1-3266106e761c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:32.442490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7a198bb-6a8f-45ca-b3f1-3266106e761c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:32.618956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7a198bb-6a8f-45ca-b3f1-3266106e761c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:32.631808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7a198bb-6a8f-45ca-b3f1-3266106e761c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1240 microversion: 2.1 time: 0.215665 Aug 24 11:26:32.657468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 6/9] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:32 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:32.774197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1871944479", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7895ab0-bf6d-488a-8b51-ae8134e3afb6"}], "security_groups": [{"name": "tempest-securitygroup--980840181"}], "key_name": "tempest-keypair-2079084680", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:32.890968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:32.916945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6864298c-d29f-408d-bee7-1c54b7197577 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.966330 Aug 24 11:26:32.917819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 4/10] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:31 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:32.959207 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] validate_networks() for [('f7895ab0-bf6d-488a-8b51-ae8134e3afb6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:33.007554 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-982857064", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:33.142599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] validate_networks() for [('c70bafd0-5a35-4f61-9bc3-c5b84adfc134', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:34.404718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:34.405755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:34.406242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:34.406655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:34.407067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:34.435380 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.437388 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.438134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.439213 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.439809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.440658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.497681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:34.511198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for user 6a2bfeaa15ee4ef3bcaa21e22c71895d and project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:34.530057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:34.533175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:34.656517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be96f448-34a2-436b-961a-bba078ae1dd2 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.888838 Aug 24 11:26:34.663126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 7/11] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Aug 24 11:26:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 11:26:34.680823 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:34.686235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:34.706480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.707383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.708000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.708904 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.709627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.710773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.870144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:34.882315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bfb90b3-0aea-4b1b-a0e1-5813c9fbbc77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1292 microversion: 2.1 time: 0.212741 Aug 24 11:26:34.884247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 8/12] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:34 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1292 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:34.891564 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:34.892373 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:34.907317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.908123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.909160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.910356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.921406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.922058 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.540164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:35.540775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:35.541261 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:35.541762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:35.542238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:35.588055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:35.590854 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:35.596151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.597749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:35.624073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:35.632041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.779425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:35.816338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for user 6f7224ed18ba423084846da68a920f52 and project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:35.991113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:36.001277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.015591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:36.023286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c319f19-ca14-424d-a9bd-e5d91f7bde23 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 1.136346 Aug 24 11:26:36.026104 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 9/13] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:34 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:36.032068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec848241-0f46-4889-8650-c6152890aa2f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:36.054063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec848241-0f46-4889-8650-c6152890aa2f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:36.207590 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec848241-0f46-4889-8650-c6152890aa2f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.218106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec848241-0f46-4889-8650-c6152890aa2f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.220215 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec848241-0f46-4889-8650-c6152890aa2f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.231564 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec848241-0f46-4889-8650-c6152890aa2f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1282 microversion: 2.20 time: 0.206380 Aug 24 11:26:36.250233 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 10/14] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:36 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:36.263094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:36.277853 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:36.300218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:36.301371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:36.305996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5a12b461-29b4-49ab-905c-421894bb053a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.302070 Aug 24 11:26:36.306767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 5/15] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:26:36.308113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:36.309932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:36.315025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:36.316166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:36.332211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2c61a4e-e993-43ee-894c-e8254c121e83 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:36.334042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2c61a4e-e993-43ee-894c-e8254c121e83 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:36.528299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.542860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce01aa60-6c41-4a89-83b9-ae1461a4363b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1298 microversion: 2.1 time: 0.291352 Aug 24 11:26:36.557328 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 11/16] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:36 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1298 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:36.607304 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2c61a4e-e993-43ee-894c-e8254c121e83 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.620059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2c61a4e-e993-43ee-894c-e8254c121e83 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1221 microversion: 2.1 time: 0.303473 Aug 24 11:26:36.631007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 6/17] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:36 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:37.046902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:37.047588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:37.064484 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.065725 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.066516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.067643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.068312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.068958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.259391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:37.260096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:37.285287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.285820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.291261 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.295510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.301009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.301580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.634735 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:37.653096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:37.659860 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:37.673778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9246fa40-b495-472e-8aca-97cf288be4cb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1278 microversion: 2.20 time: 0.420917 Aug 24 11:26:37.674299 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 7/18] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:37 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1278 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:37.717539 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:37.719584 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:37.733009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.734211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.736320 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.738416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.740582 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.741232 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:38.389647 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:38.403926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e49a3124-3704-4128-8fea-1d7a5b6e9b8e tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 1.359176 Aug 24 11:26:38.417775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 12/19] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:37 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:38.438564 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:38.441068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:38.465014 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:38.467335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:38.469147 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:38.470602 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:38.472302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:38.472855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:38.673069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:38.683118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-760506ca-8559-4507-9b6a-50fba8004de5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1225 microversion: 2.1 time: 0.263759 Aug 24 11:26:38.688311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 13/20] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:38 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1225 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:38.884628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841c3b38-934d-454d-8898-a48f3b0ec74b", "tag": "2316946a-6bb4-4048-b0bb-23d086ed2b23"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:38.920267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:38.920877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:38.938839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:38.995542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:39.005392 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32cdbe0a-37e7-422d-a0fb-e304df0cc2cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1298 microversion: 2.1 time: 1.306936 Aug 24 11:26:39.025232 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 8/21] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:37 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1298 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:39.049344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:39.050088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:39.059957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Creating event network-changed:2316946a-6bb4-4048-b0bb-23d086ed2b23 for instance 841c3b38-934d-454d-8898-a48f3b0ec74b on hv-cinder-85427 Aug 24 11:26:39.061012 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:26:39.064229 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1560905-b285-4d34-84b4-a5393512187a req-be96e325-d7b1-4491-b094-c21a09b2046e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:26:39.070669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.072839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.075515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.077658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.078611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.080875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.083189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.083305 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.086619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.087390 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.088280 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.089714 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.159307 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.compute.rpcapi [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:26:39.161139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] Releasing lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:26:39.250378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80a8bd5e-87e2-4654-8c46-51c1d2ef136e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560358 Aug 24 11:26:39.251418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 14/22] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:39.445917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:39.448052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:39.475255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.480776 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.484888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.488085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.491729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.493997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.744128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:39.766804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:39.775580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:39.779151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9664f2a-8d4f-41a7-b927-0e56e7f28426 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1352 microversion: 2.20 time: 0.750075 Aug 24 11:26:39.782082 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 9/23] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:39 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1352 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:39.795368 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:39.798524 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:39.814022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.817700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.818399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:39.820777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:39.823510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:39.824241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:40.000928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:40.024781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b87e7607-1b8c-406c-bcc1-f19bb393a1be tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1273 microversion: 2.1 time: 0.234912 Aug 24 11:26:40.028665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 10/24] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:39 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:40.052181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:40.057049 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:40.071733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:40.085663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:40.090503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:40.091387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:40.102081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:40.102731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:40.904704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:40.917969 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec5d1932-08e0-43f6-8890-c3979c808e68 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 1.490603 Aug 24 11:26:40.920748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 15/25] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:39 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:40.935916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:40.938120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:40.953774 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:40.955578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:40.956961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:40.959187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:40.982962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:40.983767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:41.306557 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:41.322739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:41.324695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:41.327261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-daaf27fe-ce7a-4fe3-93eb-ab285dd36591 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1340 microversion: 2.20 time: 0.405058 Aug 24 11:26:41.328496 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 16/26] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:40 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1340 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:41.362806 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:41.369727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:41.393299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:41.394124 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:41.394830 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:41.403585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:41.404980 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:41.405588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.154709 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:42.166464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-be9d5b3f-f1a0-4468-86f5-088d0be6acee tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 2.134976 Aug 24 11:26:42.181589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 11/27] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:40 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:42.197065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:42.198921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:42.215344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.215867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.216619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.217400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.223728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.224947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.492954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:42.508614 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a23c746-b1c6-4c8d-800a-2b78e26c9b38 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1279 microversion: 2.1 time: 1.174558 Aug 24 11:26:42.510727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 17/28] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:41 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1279 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:42.516034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:42.517100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:42.527836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.530004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.530859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.532139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.533314 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.533981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.999647 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.032252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.040366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.043100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5460f34-fcca-4646-a43f-33edd814a448 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1340 microversion: 2.20 time: 0.531109 Aug 24 11:26:43.046430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 18/29] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:42 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1340 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:43.188785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:43.189585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:43.197537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:43.207042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.212041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.212041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.222501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.223359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.224038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.581255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.600561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-58cb0e84-541b-499b-875b-9d6552b869a9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 1.415128 Aug 24 11:26:43.603060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 12/30] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:42 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:43.617963 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:43.621765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:43.637829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.639181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.639943 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.641382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.642340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.643147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.700310 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.719173 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36819327-b6d0-4e86-ae5b-89de4d01a01c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.533522 Aug 24 11:26:43.733224 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 19/31] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:43 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:43.957060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.989457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd96cc01-5115-4dca-b877-70059ae97660 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1279 microversion: 2.1 time: 0.383032 Aug 24 11:26:43.990164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 13/32] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:43 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:44.072491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:44.073374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:44.087997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.088751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.092066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.093015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.093664 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.094325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.200521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-1f3047f7-629a-4152-9031-a4fd9a0a84e3 req-76b33889-3447-4cd6-8118-94c4835f9219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d189eb-9185-44a8-9935-0f111df1392a", "tag": "565171f6-781f-4abf-be7d-35ef0a25f7ad"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:44.223907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f3047f7-629a-4152-9031-a4fd9a0a84e3 req-76b33889-3447-4cd6-8118-94c4835f9219 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.229817 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f3047f7-629a-4152-9031-a4fd9a0a84e3 req-76b33889-3447-4cd6-8118-94c4835f9219 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.230679 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-1f3047f7-629a-4152-9031-a4fd9a0a84e3 req-76b33889-3447-4cd6-8118-94c4835f9219 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.258411 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-1f3047f7-629a-4152-9031-a4fd9a0a84e3 req-76b33889-3447-4cd6-8118-94c4835f9219 service nova] Creating event network-changed:565171f6-781f-4abf-be7d-35ef0a25f7ad for instance f2d189eb-9185-44a8-9935-0f111df1392a on hv-cinder-85427 Aug 24 11:26:44.275631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-1f3047f7-629a-4152-9031-a4fd9a0a84e3 req-76b33889-3447-4cd6-8118-94c4835f9219 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231609 Aug 24 11:26:44.276323 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 20/33] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:44.575499 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:44.592162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:44.597088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:44.600031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-27c2a6a2-f4a8-42e9-9c0e-e611e1677271 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1340 microversion: 2.20 time: 0.531617 Aug 24 11:26:44.603439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 14/34] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:44 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1340 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:44.634561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:44.635689 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:44.652003 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.657047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.660232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.662566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.668404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.669343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.745577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:44.746257 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:44.759156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.779232 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.781905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.782860 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.784197 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.787235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.515823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:45.535861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48960365-5f83-4b4a-95fb-7e8a2f5de3b9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.795591 Aug 24 11:26:45.539518 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 15/35] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:44 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:45.561768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:45.562924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:45.579521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.579985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.584728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.586953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.592356 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.595914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.706081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:45.797569 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:45.807121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:45.816342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-810b63e2-dca1-43e3-8980-4720d31643b5 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 1.187704 Aug 24 11:26:45.817548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c2b6b67-ba6e-4bc1-af8d-0477e909d224 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1279 microversion: 2.1 time: 0.276686 Aug 24 11:26:45.818309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 16/36] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:45 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:45.826969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:45.827946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:45.834716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.837145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.837793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.839096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.839780 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.840766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.844517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 21/37] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:44 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:46.304677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ae3e46bb-083b-416d-ad35-75707746c789 req-9e2e309a-f274-4ce0-8afc-e17b8df2c727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bc3b79-e078-405a-9d06-0a01d90b0dde", "tag": "62e4296a-e8be-44f0-8599-a8e7b4d4ff36"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:46.322126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:46.329320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae3e46bb-083b-416d-ad35-75707746c789 req-9e2e309a-f274-4ce0-8afc-e17b8df2c727 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:46.329320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae3e46bb-083b-416d-ad35-75707746c789 req-9e2e309a-f274-4ce0-8afc-e17b8df2c727 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:46.329653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae3e46bb-083b-416d-ad35-75707746c789 req-9e2e309a-f274-4ce0-8afc-e17b8df2c727 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:46.381721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ae3e46bb-083b-416d-ad35-75707746c789 req-9e2e309a-f274-4ce0-8afc-e17b8df2c727 service nova] Creating event network-changed:62e4296a-e8be-44f0-8599-a8e7b4d4ff36 for instance 91bc3b79-e078-405a-9d06-0a01d90b0dde on hv-cinder-85427 Aug 24 11:26:46.404797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ae3e46bb-083b-416d-ad35-75707746c789 req-9e2e309a-f274-4ce0-8afc-e17b8df2c727 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105944 Aug 24 11:26:46.405887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 22/38] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:46.454482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:46.475111 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:46.485139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:46.486530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cc4c3bc6-b1e3-4227-b143-d31773a26b73 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.665976 Aug 24 11:26:46.495725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 17/39] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:45 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:46.561041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:46.561777 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:46.592751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:46.595737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:46.596273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:46.597025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:46.601978 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:46.603345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:46.842700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:46.844081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:46.852901 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=20 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:46.859892 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:46.861388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:46.862805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:46.866949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:46.868874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:46.878462 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:46.956637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:46.983302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa9b4a09-4ff8-49ae-90a1-ec20115ffb63 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.424145 Aug 24 11:26:46.984693 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 23/40] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:46 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:47.003516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:47.016103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:47.033931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:47.034456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:47.034899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:47.035718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:47.044112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:47.044789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:47.348408 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:47.364684 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5a7ab0b-a587-497c-bd6b-89d701237e21 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.374024 Aug 24 11:26:47.365620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 24/41] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:46 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:47.526576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:47.527807 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:47.541594 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:47.542401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:47.542993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:47.545093 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:47.545816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:47.546670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:47.552721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:47.621545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:47.633935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e74eb47-26ce-417e-b1ea-cecd76fed1b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.795212 Aug 24 11:26:47.638783 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 18/42] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:46 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:47.915970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:47.931813 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:47.937134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:47.945115 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38748d56-9c92-4016-a39f-96b504436ea4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.424748 Aug 24 11:26:47.961351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 25/43] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:47 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:48.009967 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:48.011739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:48.019995 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.020729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.022004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.023879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.024755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.025426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.077732 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d1d5da61-d835-41ff-94d0-796ec6e26efa req-e0698011-3f5f-48b3-a1bf-7b3317eaf813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:48.092212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d1d5da61-d835-41ff-94d0-796ec6e26efa req-e0698011-3f5f-48b3-a1bf-7b3317eaf813 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.093125 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d1d5da61-d835-41ff-94d0-796ec6e26efa req-e0698011-3f5f-48b3-a1bf-7b3317eaf813 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.093952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d1d5da61-d835-41ff-94d0-796ec6e26efa req-e0698011-3f5f-48b3-a1bf-7b3317eaf813 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.113034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d1d5da61-d835-41ff-94d0-796ec6e26efa req-e0698011-3f5f-48b3-a1bf-7b3317eaf813 service nova] Creating event network-changed:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:26:48.120359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d1d5da61-d835-41ff-94d0-796ec6e26efa req-e0698011-3f5f-48b3-a1bf-7b3317eaf813 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046525 Aug 24 11:26:48.121735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 26/44] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:48.328353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:48.337926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-40b0af42-0c6f-45dc-adb4-c6d0354dc1dd tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.333074 Aug 24 11:26:48.344762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 19/45] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:48 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:48.389778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:48.389925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:48.408185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.409005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.410144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.411075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.411741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.412519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.656658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:48.657463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:48.683313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.684278 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.692652 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.694043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.694891 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.701193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.124280 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:49.141130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.179926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22f4a938-d125-40e9-89ac-95b380da18fd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.784390 Aug 24 11:26:49.183198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 27/46] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:48 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:49.197162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:49.203140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:49.222007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:49.224348 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:49.225457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.229710 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:49.230434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:49.231930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.249761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.268270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-04ebd944-6496-477a-9e85-6ff960f91e62 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.614315 Aug 24 11:26:49.269455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 20/47] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:48 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:49.367689 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:49.368626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:49.383167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:49.383668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:49.384192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.386021 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:49.388113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:49.390048 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.611756 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.615742 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:49.624962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7e0b466-e3a1-4ce1-8935-187b893bbfd6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.263464 Aug 24 11:26:49.625581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 21/48] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:49 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:49.920207 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.934934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.936767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.937909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32371247-b87c-4d1a-871b-086afb37f6fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.751992 Aug 24 11:26:49.938636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 28/49] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:49 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:50.159332 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fe0be5-3ba8-4676-85ab-9d684b791acc", "tag": "0d08a08e-ebd6-4093-854e-61076478683a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:50.184928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.186648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.188113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.212669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:50.221220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:50.260374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.269451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.270372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.271600 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.277420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.280706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.327295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Creating event network-changed:0d08a08e-ebd6-4093-854e-61076478683a for instance d3fe0be5-3ba8-4676-85ab-9d684b791acc on hv-cinder-85427 Aug 24 11:26:50.334403 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:26:50.335356 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a7c954c5-c4b9-4c31-b311-b21a4d7ba7eb req-218624db-3cb9-4ed0-b15b-c33f13b891b8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:26:50.337377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.338864 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.339817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.342526 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.345728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.349078 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.400340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.compute.rpcapi [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:26:50.402007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] Releasing lock "compute-rpcapi-router" {{(pid=120722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:26:50.452501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2f0be259-ea67-45fe-81a8-4483a97c0517 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300110 Aug 24 11:26:50.453580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 22/50] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:50.465675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:50.467203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:50.480251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.481907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.483855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.485816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.486892 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.487868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:51.315522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:51.331803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab941208-99ec-483c-9ab9-53ed7188f655 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 1.128223 Aug 24 11:26:51.333458 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 29/51] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:50 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:51.336773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:51.339758 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:51.346363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b07a5c5-4166-4958-92ac-5d6b7cc69b78 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.890841 Aug 24 11:26:51.346954 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 23/52] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:50 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:51.347710 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:51.356392 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:51.357397 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:51.362396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:51.365165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:51.366327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:51.367019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:51.367465 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:51.367872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:51.368902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:51.369701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:51.370313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:51.370986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:51.375637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:51.376426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:51.710849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:51.721738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:51.724143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:51.727361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:51.728864 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a527d585-4638-4e87-a3a9-8555e2b1f948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.380811 Aug 24 11:26:51.729833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 24/53] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:51 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:51.744738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-932a5166-aa77-45ba-a29a-65b50af590ac tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.409739 Aug 24 11:26:51.748120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 30/54] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:51 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:52.379107 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:52.381538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:52.388668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:52.388668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:52.398692 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:52.400759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:52.401824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:52.402410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:52.402738 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:52.403157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:52.404053 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:52.404543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:52.404970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:52.405089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:52.405914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:52.406452 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:52.406955 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:52.822752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:52.833746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-272bb8ca-589a-4aa5-a718-766e9b6abdfd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.457701 Aug 24 11:26:52.834725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 25/55] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:52 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:52.843381 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:52.844312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:52.864857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:52.870290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:52.871306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:52.873501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:52.874238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:52.874884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:53.170845 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:53.182678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19b44c9d-f338-4ede-b920-7edb985cdeb5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.804209 Aug 24 11:26:53.185848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 31/56] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:52 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:53.215907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:53.216585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:53.233451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:53.234004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:53.234555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:53.235397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:53.242388 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:53.243031 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:53.292498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:53.306238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:53.307832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:53.308977 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9c777665-1436-4187-85f2-adffe9a57771 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.472335 Aug 24 11:26:53.309686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 26/57] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:52 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:53.531131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:53.540317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76d398a0-258a-4488-95f6-ebb8784c3fb4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.337188 Aug 24 11:26:53.540901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 32/58] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:53 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:53.856299 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:53.857007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:53.863861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:53.864454 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:53.864889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:53.865626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:53.866832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:53.867262 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.022878 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.030832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-845c69fa-e4e6-4478-9ce8-c4eb8fd800ac tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.178464 Aug 24 11:26:54.031416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 27/59] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:53 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:54.208883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:54.209681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:54.216433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.216908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.217383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.218071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.218521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.218942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.332065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:54.332678 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:54.339797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.340290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.340726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.341447 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.341899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.342797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.353226 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.361172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffb82799-1787-4eaa-b8ea-ebca9456c248 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.156758 Aug 24 11:26:54.362326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 33/60] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:54 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:54.482805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.492150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.493931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.495136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-502a310d-02c0-462b-a7dd-d56e62e04983 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.167002 Aug 24 11:26:54.495872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 28/61] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:54 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:54.562417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:54.563766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:54.571315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.571894 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.572504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.573377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.573832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.574279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.734703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.743302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98f89d33-c122-42fd-89ca-4f4e9900a19d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.184988 Aug 24 11:26:54.743883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 34/62] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:54 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:55.053315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:55.054226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:55.060579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.061071 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.061544 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.062249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.062706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.063136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.207425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.215987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c35dafcd-2221-42e2-b23c-1d3e9af366e1 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.166491 Aug 24 11:26:55.216830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 29/63] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:55 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:55.384250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:55.385320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:55.395102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.395910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.396638 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.398701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.399408 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.400386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.519575 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:55.520191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:55.527342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.527844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.528281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.529483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.530064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.530363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.550967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.560170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5061c3ce-9979-4aed-a451-ad73a3339486 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.181853 Aug 24 11:26:55.560758 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 35/64] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:55 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:55.687532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.696506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.698242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.699518 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a8f295b-7655-4036-8bf3-ab4670294b7f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.183906 Aug 24 11:26:55.700072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 30/65] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:55 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:26:55.765028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:55.766237 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:55.772817 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.773400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.773836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.774566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.775014 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.775437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.966274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.974375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9909865-a96d-4f7b-8d9f-3da9c0fbae7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.213202 Aug 24 11:26:55.975971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 36/66] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:55 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:56.237193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:56.237848 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:56.245474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.245974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.246414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.247121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.247603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.248028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.387913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.395920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2c8a76f-ac32-48eb-b6ca-b1dda7126a82 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.162525 Aug 24 11:26:56.396591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 31/67] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:56 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:56.587342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:56.587954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:56.593905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.594395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.595055 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.595527 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.595979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.596407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.722247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:56.722881 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:56.732678 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.733172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.733668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.734546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.734999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.735437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.762865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.774385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b26da559-038d-4d0c-a54f-45d02fc41b96 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.195353 Aug 24 11:26:56.776153 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 37/68] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:56 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:56.898879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.907478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.909135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.910354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a45230f-e467-4231-9884-0b64e5db0489 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.192037 Aug 24 11:26:56.910987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 32/69] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:56 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:26:57.003490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.004971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.015647 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.017329 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.017915 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.027002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.027867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.028463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.180410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:57.189621 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30f8e1fa-b7b3-4a5e-b47c-4b7c62c2c25f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.190959 Aug 24 11:26:57.193354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 38/70] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:56 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:57.417409 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.418029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.425365 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.425365 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.425365 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.425614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.426059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.426486 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.608200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:57.623885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84de6f24-6870-491c-b59c-276dde35dced tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.209719 Aug 24 11:26:57.638187 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 33/71] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:57 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:57.796116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.797307 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.805080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.806143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.806570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.807657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.808311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.809078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.942432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.943057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.952862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.953561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.954365 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.956526 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.957013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.957483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.043631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.054271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4ab4253-9cda-4830-9578-84eb683a7efe tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.259553 Aug 24 11:26:58.058619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 39/72] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:57 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:58.248494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.281850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-729c7ef7-b962-4828-a8f0-1d0c6051234d req-ee7ffd8e-6219-40f2-bf60-10b88e063021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841c3b38-934d-454d-8898-a48f3b0ec74b", "name": "network-vif-plugged", "status": "completed", "tag": "2316946a-6bb4-4048-b0bb-23d086ed2b23"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:58.294778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.294945 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-729c7ef7-b962-4828-a8f0-1d0c6051234d req-ee7ffd8e-6219-40f2-bf60-10b88e063021 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.295393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-729c7ef7-b962-4828-a8f0-1d0c6051234d req-ee7ffd8e-6219-40f2-bf60-10b88e063021 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.297051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-729c7ef7-b962-4828-a8f0-1d0c6051234d req-ee7ffd8e-6219-40f2-bf60-10b88e063021 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.302826 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.309681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b8c7a7c-28f1-4380-8f75-e60a9e1ffca3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.373600 Aug 24 11:26:58.310292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 34/73] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:57 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:58.325378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-729c7ef7-b962-4828-a8f0-1d0c6051234d req-ee7ffd8e-6219-40f2-bf60-10b88e063021 service nova] Creating event network-vif-plugged:2316946a-6bb4-4048-b0bb-23d086ed2b23 for instance 841c3b38-934d-454d-8898-a48f3b0ec74b on hv-cinder-85427 Aug 24 11:26:58.326984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:58.327830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:58.333398 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-729c7ef7-b962-4828-a8f0-1d0c6051234d req-ee7ffd8e-6219-40f2-bf60-10b88e063021 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166674 Aug 24 11:26:58.334701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 40/74] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:58.353866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.354696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.355629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.356590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.357147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.358352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.612912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.622879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce9aa3b8-3a81-4a7d-9e23-f93ab9382574 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.309577 Aug 24 11:26:58.623465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 35/75] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:58 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:58.665098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:58.666069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:58.676748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.680861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.681823 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.684861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.685594 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.686042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.880849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.891144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e40dc98c-9d0e-43e6-a4a3-73da74f32acf tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.231867 Aug 24 11:26:58.892459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 41/76] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:58 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:59.082617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:59.083405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:59.089660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.090197 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.090632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.091322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.091931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.092358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.267061 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.275058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff10aa1f-5196-4862-8969-37073d47feb9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.196990 Aug 24 11:26:59.275642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 36/77] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:59 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:59.333034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:59.333764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:59.342882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.343375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.343814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.344726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.345421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.345858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.517254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.534841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.536694 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.538207 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b3e6c44-c963-40a3-90f7-a253023f56a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.209485 Aug 24 11:26:59.539556 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 42/78] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:26:59 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:26:59.647147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:59.648428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:59.660745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.662364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.663490 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.665586 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.666302 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.666995 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.852581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.865849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-21334e22-b660-4ffe-afcc-e459760a947c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.222602 Aug 24 11:26:59.867899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 37/79] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:59 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:59.918165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:59.918907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:59.929120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.930139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.930999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.931933 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:59.932805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:59.933468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:59.961987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:00.296454 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:00.297177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:00.305907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.306506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.307093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.307913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.308666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.309172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.385580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:00.420708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.429433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d36071b7-bdd4-4275-853e-d12c21489db3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1315 microversion: 2.1 time: 0.521291 Aug 24 11:27:00.430688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 43/80] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:59 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:00.445714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d189eb-9185-44a8-9935-0f111df1392a", "name": "network-vif-plugged", "status": "completed", "tag": "565171f6-781f-4abf-be7d-35ef0a25f7ad"}, {"server_uuid": "91bc3b79-e078-405a-9d06-0a01d90b0dde", "name": "network-vif-plugged", "status": "completed", "tag": "62e4296a-e8be-44f0-8599-a8e7b4d4ff36"}, {"server_uuid": "d3fe0be5-3ba8-4676-85ab-9d684b791acc", "name": "network-vif-plugged", "status": "completed", "tag": "0d08a08e-ebd6-4093-854e-61076478683a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:00.458967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.460431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.461604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.484327 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Creating event network-vif-plugged:565171f6-781f-4abf-be7d-35ef0a25f7ad for instance f2d189eb-9185-44a8-9935-0f111df1392a on hv-cinder-85427 Aug 24 11:27:00.484863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Creating event network-vif-plugged:62e4296a-e8be-44f0-8599-a8e7b4d4ff36 for instance 91bc3b79-e078-405a-9d06-0a01d90b0dde on hv-cinder-85427 Aug 24 11:27:00.485502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] Creating event network-vif-plugged:0d08a08e-ebd6-4093-854e-61076478683a for instance d3fe0be5-3ba8-4676-85ab-9d684b791acc on hv-cinder-85427 Aug 24 11:27:00.495577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.495827 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ed938bde-97a5-4210-aee1-c2d0a3ec1ac8 req-5d709a2b-584b-4a30-af27-3d294663e5d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063587 Aug 24 11:27:00.496687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 44/81] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:00.500752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:00.508249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c62d4d38-a063-4bdb-868e-58798aa44297 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.216101 Aug 24 11:27:00.508991 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 38/82] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:00 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:00.563672 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:00.564377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:00.571552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.572081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.572513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.574930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.574930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.574930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.781176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.794615 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.797257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.799202 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e6ae723d-b243-408a-a195-13132b6a6ccb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.239980 Aug 24 11:27:00.800129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 45/83] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:00 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:00.890706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:00.892101 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:00.900968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.901827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.903125 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.904102 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.904668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.905218 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.104923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:01.116518 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0b91cd38-f939-40ce-870e-ee8b69c07901 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.231793 Aug 24 11:27:01.134223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 39/84] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:00 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:01.462967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:01.465346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:01.496953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.499159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.500011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.501854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.504345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.507781 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.535771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:01.536294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:01.563220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.565188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.565872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.567433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.571350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.572053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.020750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.026246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.036964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9c21142-5a7c-41e1-80af-c95a1caf23dd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1503 microversion: 2.1 time: 0.577227 Aug 24 11:27:02.036964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 46/85] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:01 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:02.041074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-987bd831-8663-4dc0-8829-73745f9d069d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.514943 Aug 24 11:27:02.042302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:02.042974 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:02.044341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 40/86] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:01 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:02.066885 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.068100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.074133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.075030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.075632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.076155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.143017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:02.143751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:02.155432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.156026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.159906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.159906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.159906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.159906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.393572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.403227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.406549 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82df6e2f-0816-4cd8-b2e4-62f630a4a2cb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.267101 Aug 24 11:27:02.408258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 41/87] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:02 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:02.416406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.417948 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.423004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-45478af2-889a-4ab0-b62b-9bf907c2f7fb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.383976 Aug 24 11:27:02.423717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 47/88] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:02 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:02.516757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-0b05b75d-2b6f-4e12-9995-3d7b6bf0395e req-df811d75-f02f-4eff-9155-ebab3b13fb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "name": "network-vif-plugged", "status": "completed", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:02.527148 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0b05b75d-2b6f-4e12-9995-3d7b6bf0395e req-df811d75-f02f-4eff-9155-ebab3b13fb7a service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.527653 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0b05b75d-2b6f-4e12-9995-3d7b6bf0395e req-df811d75-f02f-4eff-9155-ebab3b13fb7a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.528434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-0b05b75d-2b6f-4e12-9995-3d7b6bf0395e req-df811d75-f02f-4eff-9155-ebab3b13fb7a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.542935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-0b05b75d-2b6f-4e12-9995-3d7b6bf0395e req-df811d75-f02f-4eff-9155-ebab3b13fb7a service nova] Creating event network-vif-plugged:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:27:02.551686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-0b05b75d-2b6f-4e12-9995-3d7b6bf0395e req-df811d75-f02f-4eff-9155-ebab3b13fb7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038149 Aug 24 11:27:02.552352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 42/89] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:03.067036 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:03.068382 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:03.075937 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.076805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.077468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.078310 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.078765 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.079210 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.237502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:03.248917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e062a8e4-3875-4966-95d6-2401864ea891 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.186521 Aug 24 11:27:03.249410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 48/90] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:03 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:03.428214 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:03.430437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:03.437492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.438216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.438807 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.441157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.441658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.442430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.446868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:03.448076 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:03.456037 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.456532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.456969 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.457702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.458384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.458966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.625945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:03.640367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6d676784-e250-4e94-99a9-37eeb137f8d9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.212883 Aug 24 11:27:03.655145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 43/91] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:03 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:03.707126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:03.716211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:03.717875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:03.719378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-547092da-a944-435c-963f-051a6847b36c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.277089 Aug 24 11:27:03.719942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 49/92] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:03 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:27:04.273862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:04.274535 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:04.280958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.281754 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.282270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.283154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.283912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.284681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.435253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.445503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-209ba18a-189e-43cf-8765-257a9165f5b5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.176357 Aug 24 11:27:04.446089 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 44/93] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:04 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:04.665675 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:04.666291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:04.672469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.673370 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.674052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.675072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.677520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.678260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.743188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:04.743795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:04.750724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.751221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.751666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.752364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.754418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.756205 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.855383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.863235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fec2c082-23be-45a7-b507-20a9f5d5a6e8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.202973 Aug 24 11:27:04.864140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 50/94] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:04 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:04.922413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.932525 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.934045 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.935150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d60a5f9b-fa19-4a67-81cf-cb048f954999 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.196034 Aug 24 11:27:04.935861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 45/95] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:04 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:27:05.466654 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:05.467648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:05.474017 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.475081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.476252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.477027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.477857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.478292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.670752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:05.681021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-581632dd-8843-4f15-ab60-e3b2b636fd3a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.218053 Aug 24 11:27:05.682117 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 51/96] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:05 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:05.858771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c175cb11-7f1c-4e5d-83db-837e4a43155d"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:05.862097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:05.869116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.869643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.870236 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.871188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.871865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.872361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.886324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:05.887619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:05.894637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.895588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.896261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.897404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.898524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.899346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.064102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.072065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d72b3b0-4ada-4248-801c-3cd5a2adca47 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1365 microversion: 2.1 time: 0.191582 Aug 24 11:27:06.072653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 52/97] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:05 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:06.077895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:06.078491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:06.084913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:06.085565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:06.086189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.087302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:06.087953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:06.088562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.255588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.266282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.268205 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.269534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-310ecd7f-79db-43d3-84cc-328f26771e68 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.195886 Aug 24 11:27:06.270114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 53/98] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:06 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:06.704783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:06.705467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:06.719103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:06.719958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:06.720562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.721768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:06.722225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:06.723570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.888508 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.898101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d69bff2-5021-426e-a723-99ff6002cbfb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1321 microversion: 2.1 time: 0.198254 Aug 24 11:27:06.902281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 54/99] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:06 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:07.100280 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:07.101495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:07.111130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.112520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.113294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.114287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.114930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.115702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.313785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:07.322394 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8642284d-a3f0-419c-8841-46c2cb478d69 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1554 microversion: 2.1 time: 0.233277 Aug 24 11:27:07.323185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 55/100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:07 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:07.327818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:07.328614 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:07.334687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.335746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.336348 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.337227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.337876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.338432 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.540160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:07.548846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:07.550540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:07.552362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e5cc5b9-8d61-4a2d-af50-fc7684297958 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.227987 Aug 24 11:27:07.555726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 56/101] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:07 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:07.563737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:07.565455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:07.578826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.579685 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.580341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.581317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.582212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.583129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.750520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-067a6f25-bb5d-4ed9-9822-6beb52b6d109 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191333 Aug 24 11:27:07.750520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 57/102] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:27:07 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:07.924063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:07.925186 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:07.940243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.941042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.945522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.946448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.947061 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.947636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.181596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:08.190566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5ec9b72-4d00-4cc4-858b-116a4f82fe63 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1515 microversion: 2.1 time: 0.271566 Aug 24 11:27:08.191283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 58/103] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:07 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:08.239901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:08.258760 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:08.271115 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.273367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.277456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.278380 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.278992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.279644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.309037 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lazy-loading 'flavor' on Instance uuid d3fe0be5-3ba8-4676-85ab-9d684b791acc {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:08.408161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:08.467989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a618eff2-a856-42bc-bb9d-a1b5e341c26b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc/action" status: 200 len: 32 microversion: 2.1 time: 0.246865 Aug 24 11:27:08.473405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 59/104] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:08 2022] POST /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:27:08.479866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:08.480566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:08.487554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.487969 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.488405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.489108 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.489590 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.490011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.698694 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:08.715170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94c2a267-f561-45eb-8912-ec6bcefcc3b3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.239978 Aug 24 11:27:08.716330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 60/105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:08 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:08.728967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:08.730149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:08.739201 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.741181 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.742052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.743108 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.743850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.744447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.048894 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:09.058411 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:09.060272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:09.061551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce82fc70-4bf1-471d-b856-5c40924170a9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.342370 Aug 24 11:27:09.073450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 61/106] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:08 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:09.111833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5e8e9b3-0509-4b4e-b2a4-a196ec7e0370 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "POST /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.257640 Aug 24 11:27:09.112484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 46/107] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:27:05 2022] POST /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b/os-volume_attachments => generated 194 bytes in 3259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:09.322093 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-922027695", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:09.385551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:09.538192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-73505306-dd52-4c45-8007-b9bf21c560bb req-76b462dd-14d0-4aaf-8e36-06e38ae11321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d189eb-9185-44a8-9935-0f111df1392a", "tag": "565171f6-781f-4abf-be7d-35ef0a25f7ad"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:09.565360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-73505306-dd52-4c45-8007-b9bf21c560bb req-76b462dd-14d0-4aaf-8e36-06e38ae11321 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.570660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-73505306-dd52-4c45-8007-b9bf21c560bb req-76b462dd-14d0-4aaf-8e36-06e38ae11321 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.571551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-73505306-dd52-4c45-8007-b9bf21c560bb req-76b462dd-14d0-4aaf-8e36-06e38ae11321 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.590494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-73505306-dd52-4c45-8007-b9bf21c560bb req-76b462dd-14d0-4aaf-8e36-06e38ae11321 service nova] Creating event network-changed:565171f6-781f-4abf-be7d-35ef0a25f7ad for instance f2d189eb-9185-44a8-9935-0f111df1392a on hv-cinder-85427 Aug 24 11:27:09.598764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-73505306-dd52-4c45-8007-b9bf21c560bb req-76b462dd-14d0-4aaf-8e36-06e38ae11321 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064265 Aug 24 11:27:09.599985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 47/108] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:09.739318 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:09.740406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:09.748117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.748997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.749601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.750919 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.751515 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.752156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.807020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:09.807369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:09.807879 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:09.808604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:09.809026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:09.821384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.821878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.822348 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.823268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.823726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.824152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.860610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Getting quotas for project 92d9abd2149f43d38bad58f44b4ce033. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:09.871131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Getting quotas for user 1aaf6e3151db455ca8d4b4bfcc6a7159 and project 92d9abd2149f43d38bad58f44b4ce033. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:09.887873 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:09.890636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:09.935286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:09.948658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:09.958715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6054c0a4-621a-48fa-97a5-7e0084a04510 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.223873 Aug 24 11:27:09.960390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 48/109] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:09 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:09.976805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f646c816-71c4-42a0-9e11-1d5e9f8503a5 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669115 Aug 24 11:27:09.978086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 62/110] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:27:09.991544 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-325babd7-8cab-4a9d-bc36-c7432c906e76 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:09.992787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-325babd7-8cab-4a9d-bc36-c7432c906e76 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:10.087855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:10.088588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:10.103400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-325babd7-8cab-4a9d-bc36-c7432c906e76 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:10.112401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:10.112918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:10.113401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:10.114824 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-325babd7-8cab-4a9d-bc36-c7432c906e76 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1214 microversion: 2.1 time: 0.124695 Aug 24 11:27:10.117367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 49/111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:09 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:10.118057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:10.118546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:10.118985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:10.582861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:10.617069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:10.623673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:10.624971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c14ef930-1074-439b-bff8-f01040e141a8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.542330 Aug 24 11:27:10.625853 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 63/112] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:10 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:27:10.987182 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:10.987923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:11.003458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.004303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.004863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.007391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.008234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.008671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.139434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:11.139874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:11.148769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.149919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.150375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.151164 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.153854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.155574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.272640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:11.275655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:11.283278 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07f5766c-8399-41fe-86f0-8fb51be2aa6b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.302469 Aug 24 11:27:11.284083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 50/113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:10 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:11.286210 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09b9e43d-9a66-42b1-8c43-141b7a2579fe tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1210 microversion: 2.1 time: 0.150979 Aug 24 11:27:11.300888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 64/114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:11 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:11.652044 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:11.652886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:11.663134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.664325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.666600 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.667368 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.667827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.668253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.908819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:11.917937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:11.919722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:11.920837 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acc43d35-387b-414e-b998-37d4bc1e4242 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1407 microversion: 2.20 time: 0.274516 Aug 24 11:27:11.921579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 51/115] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:11 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:12.312291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:12.312910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:12.317374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:12.318559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:12.321539 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.322513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.322852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.323665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.324127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.324737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.326545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.327033 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.327463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.328381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.328822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.329464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.407958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:12.431313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aae331ea-9bee-455a-978a-b5f3b15468e4 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1266 microversion: 2.1 time: 0.122708 Aug 24 11:27:12.434847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 52/116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:12 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:12.537830 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:12.547264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4eb629af-571b-4d30-88c2-95d63df9b243 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.242699 Aug 24 11:27:12.548009 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 65/117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:12 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:12.947540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:12.948253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:12.955012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.955776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.956279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.957092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.957929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.958429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.455687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:13.456442 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:13.466330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.466898 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.467337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.468069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.468594 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.469016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.634578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:13.644477 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d30f1738-eb4c-48bd-8109-067fc82e5d73 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1272 microversion: 2.1 time: 0.192304 Aug 24 11:27:13.645874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 66/118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:13 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:13.652320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:13.653316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:13.660904 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.661791 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.662524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.664330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.665098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.665941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.704592 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:13.716566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:13.718985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:13.720899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-175114da-426b-4311-9e09-6be1c4b5e39c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1599 microversion: 2.20 time: 0.779035 Aug 24 11:27:13.721585 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 53/119] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:27:12 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1599 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:27:13.760292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:13.760886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:13.767299 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.768170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.768610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.769471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.770086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.770666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.866574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ccc3bd3f-2862-4e99-b264-ef8f347b227c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111602 Aug 24 11:27:13.867508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 54/120] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Aug 24 11:27:13 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:27:14.159941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:14.169374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83b611e0-07ec-4062-9ab4-b444edc17e99 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.522136 Aug 24 11:27:14.186543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 67/121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:13 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:14.673884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:14.674541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:14.686128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:14.686714 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:14.690972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:14.692017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:14.692620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:14.693294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:14.786417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:14.801642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-449ea8df-ff0b-4010-9eff-8f4293950698 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1272 microversion: 2.1 time: 0.134030 Aug 24 11:27:14.809528 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 55/122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:14 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:15.201610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:15.203015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:15.211798 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.212748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.213406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.214317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.215026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.215779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.715934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:15.728540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a24eebb4-59f7-4acf-b208-1a3fa48de5a7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.532869 Aug 24 11:27:15.730404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 68/123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:15 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:15.837748 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:15.839823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:15.856947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.858537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.859634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.861047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.862233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.863452 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.030624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d81d2ef5-b6a1-407e-9f22-4c7fa910b61d req-10281151-4328-4d43-91f7-4db36840a80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:16.044455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d81d2ef5-b6a1-407e-9f22-4c7fa910b61d req-10281151-4328-4d43-91f7-4db36840a80a service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.044455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d81d2ef5-b6a1-407e-9f22-4c7fa910b61d req-10281151-4328-4d43-91f7-4db36840a80a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.044455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d81d2ef5-b6a1-407e-9f22-4c7fa910b61d req-10281151-4328-4d43-91f7-4db36840a80a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.057584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d81d2ef5-b6a1-407e-9f22-4c7fa910b61d req-10281151-4328-4d43-91f7-4db36840a80a service nova] Creating event network-changed:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:27:16.063129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d81d2ef5-b6a1-407e-9f22-4c7fa910b61d req-10281151-4328-4d43-91f7-4db36840a80a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036061 Aug 24 11:27:16.065417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 69/124] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:16.197160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:16.201531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:16.210168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e46581a-cc56-4003-924c-69a0de0d30d2 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.382691 Aug 24 11:27:16.211308 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 56/125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:15 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:16.752296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:16.753734 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:16.766409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.770787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.771495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.773215 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.774206 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.775070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.872989 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a95875f0-41f7-4813-9e42-2a1523456a93 req-e0d608d5-25b8-4d72-a066-8ba648e1b614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b457f94c-cdcd-4a31-86ad-995c96ae4d8f", "tag": "5869cb0b-341f-4fe3-a140-ab76849cc0c6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:16.901306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a95875f0-41f7-4813-9e42-2a1523456a93 req-e0d608d5-25b8-4d72-a066-8ba648e1b614 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.902043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a95875f0-41f7-4813-9e42-2a1523456a93 req-e0d608d5-25b8-4d72-a066-8ba648e1b614 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.904358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a95875f0-41f7-4813-9e42-2a1523456a93 req-e0d608d5-25b8-4d72-a066-8ba648e1b614 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.958415 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a95875f0-41f7-4813-9e42-2a1523456a93 req-e0d608d5-25b8-4d72-a066-8ba648e1b614 service nova] Creating event network-changed:5869cb0b-341f-4fe3-a140-ab76849cc0c6 for instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f on hv-cinder-85427 Aug 24 11:27:16.981281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a95875f0-41f7-4813-9e42-2a1523456a93 req-e0d608d5-25b8-4d72-a066-8ba648e1b614 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116365 Aug 24 11:27:16.983458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 57/126] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:17.057106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:17.067924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95cf6272-4421-4087-832d-116c5a0060a5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.320677 Aug 24 11:27:17.068729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 70/127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:16 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:17.234163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:17.234871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:17.249273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:17.249925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:17.250385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:17.251283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:17.253344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:17.255953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:17.594248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:17.604162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-97d8b7fe-695a-4ac2-904b-42bcd32635da tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.375171 Aug 24 11:27:17.607628 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 58/128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:17 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:18.091982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:18.092755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:18.098891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:18.099366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:18.099818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.100500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:18.100936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:18.101390 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.254653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:18.263805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-638383c3-f20d-4668-9cf8-c4d290cd6854 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.175547 Aug 24 11:27:18.264387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 71/129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:18 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:18.384745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1170720362", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "networks": [{"uuid": "c04bc0a8-c5c3-4b5a-9b71-ff07b68fa5b2"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:18.446309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] validate_networks() for [('c04bc0a8-c5c3-4b5a-9b71-ff07b68fa5b2', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:18.627862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:18.628930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:18.636835 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:18.637704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:18.639005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.644379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:18.645027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:18.645676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.809677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:18.817369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab6b62fe-0368-4838-80d6-2f07ccf0ac4d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.193321 Aug 24 11:27:18.817937 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 72/130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:18 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:18.830122 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:18.830955 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:18.831629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:18.832130 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:18.832658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:18.842961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:18.843445 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:18.843888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.844610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:18.845065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:18.845526 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.862889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Getting quotas for project 30257baa3ace4435bda61ac02eaf78a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:18.867858 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Getting quotas for user 061e7f9c27e34122959fed8e48de95a3 and project 30257baa3ace4435bda61ac02eaf78a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:18.880020 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:18.883388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:18.941563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3da134be-04f0-4da7-9501-25f3f6bd437b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565002 Aug 24 11:27:18.942674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 59/131] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:27:18.953735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf272185-3e28-4d5d-9863-d7c59c6ad05a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:18.954596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf272185-3e28-4d5d-9863-d7c59c6ad05a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:19.022179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf272185-3e28-4d5d-9863-d7c59c6ad05a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:19.033346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf272185-3e28-4d5d-9863-d7c59c6ad05a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1214 microversion: 2.1 time: 0.082811 Aug 24 11:27:19.050858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 73/132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:18 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:19.283923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:19.284537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:19.291915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.292379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.292809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.293739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.294273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.294616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.476502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:19.487439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83ca0853-e69c-4395-8c12-e8e31810e523 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.207277 Aug 24 11:27:19.487955 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 60/133] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:19 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:19.835773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:19.839990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:19.840595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:19.846786 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.847258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.847681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.848360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.848802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.849227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.987038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:19.997468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34cfdb89-c3b6-46c9-8723-d3b08540d239 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.162602 Aug 24 11:27:19.997983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 74/134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:19 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:20.057780 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:20.058395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:20.064122 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.064603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.065043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.065757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.066208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.066640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.131361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:20.139537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-95dcf1a2-68f9-44c4-8a70-7d00094d2e02 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1218 microversion: 2.1 time: 0.086279 Aug 24 11:27:20.140121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 61/135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:20 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:20.509464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:20.509997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:20.515914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.516396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.516822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.517565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.518007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.518422 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.687653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:20.696745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8bb3316-e27c-44f7-8dd7-5637ea97f63f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.191753 Aug 24 11:27:20.697414 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 75/136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:20 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:21.019421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:21.020783 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:21.028920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.029362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.029797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.030496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.030946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.031367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.164257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:21.165362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:21.174805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.175296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.175722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.176429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.176971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.177420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.201724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:21.211666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ffc21fd6-eeaf-408c-b79d-0924917b1244 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.196833 Aug 24 11:27:21.212550 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 62/137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:21 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:21.259288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:21.270488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fccc205b-a2fb-4979-bf87-51786b34a9f4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1218 microversion: 2.1 time: 0.112258 Aug 24 11:27:21.271680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 76/138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:21 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:21.719657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:21.720271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:21.730170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.730652 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.731081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.731784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.732226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.732644 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.023576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:22.032217 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7e2e64cc-9c6d-4e4b-af28-607d4869e7f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.316959 Aug 24 11:27:22.032834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 63/139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:21 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:22.235160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:22.235941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:22.242840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.243396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.243909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.244657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.245168 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.245676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.298669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:22.299738 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:22.307926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.308936 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.309595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.311188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.311789 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.312381 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.633873 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:22.639153 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:22.652298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06af70a6-246a-48c4-a207-fd8a8d5aa333 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.419913 Aug 24 11:27:22.667408 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 77/140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:22 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:22.667408 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:22.667408 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:22.675242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.676103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.676768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.677735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.680315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.680863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.688773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:22.703243 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-35b982dc-4d25-413c-b99d-2fa9f965fa93 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1266 microversion: 2.1 time: 0.409540 Aug 24 11:27:22.705269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 64/141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:22 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1266 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:22.717238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:27:22.852936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2949559b-285c-4b97-b868-0a5520f3e979 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "DELETE /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 204 len: 0 microversion: 2.1 time: 0.196248 Aug 24 11:27:22.857744 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 78/142] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:27:22 2022] DELETE /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:27:22.862715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:22.863327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:22.866303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:22.879477 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.880051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.880691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.881517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.881997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.882725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.063057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:23.065827 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:23.089662 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.090515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.091268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.097714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.098683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.099454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.160112 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:23.171386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b936372-36ae-4c28-82f4-af0b7494dcbd tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1555 microversion: 2.1 time: 0.312703 Aug 24 11:27:23.181245 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 65/143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:22 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:23.375283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:23.393660 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8ca6fce-6baa-4406-856a-aba92d7a8f8b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.337212 Aug 24 11:27:23.396330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 79/144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:23 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:23.681120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:23.681769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:23.688536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.689083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.689555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.690307 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.690756 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.691188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.733621 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:23.735015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:23.745672 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.751357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.759097 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.759928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.760852 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.761337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.852105 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:23.865083 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46314683-eaeb-4e07-a4e4-faa4cdc47777 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1272 microversion: 2.1 time: 0.136709 Aug 24 11:27:23.873265 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 80/145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:23 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:23.873265 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-32e8654c-f878-4b61-9d8f-a715232baaaa req-2ad66b1d-db32-4991-ac8b-62043e079b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b457f94c-cdcd-4a31-86ad-995c96ae4d8f", "name": "network-vif-plugged", "status": "completed", "tag": "5869cb0b-341f-4fe3-a140-ab76849cc0c6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:23.882002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-32e8654c-f878-4b61-9d8f-a715232baaaa req-2ad66b1d-db32-4991-ac8b-62043e079b83 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.882848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-32e8654c-f878-4b61-9d8f-a715232baaaa req-2ad66b1d-db32-4991-ac8b-62043e079b83 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.883443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-32e8654c-f878-4b61-9d8f-a715232baaaa req-2ad66b1d-db32-4991-ac8b-62043e079b83 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.898333 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-32e8654c-f878-4b61-9d8f-a715232baaaa req-2ad66b1d-db32-4991-ac8b-62043e079b83 service nova] Creating event network-vif-plugged:5869cb0b-341f-4fe3-a140-ab76849cc0c6 for instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f on hv-cinder-85427 Aug 24 11:27:23.905753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-32e8654c-f878-4b61-9d8f-a715232baaaa req-2ad66b1d-db32-4991-ac8b-62043e079b83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 Aug 24 11:27:23.906992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 81/146] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:23.938547 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:23.945442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fd557dcc-b28f-475d-9e24-9085b7fee548 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.272936 Aug 24 11:27:23.946160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 66/147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:23 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:24.211311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:24.212023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:24.218350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.218837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.219279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.219986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.220436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.220860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.368963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:24.377557 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-883e9b42-8cb9-475e-9016-56a95923bac7 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1555 microversion: 2.1 time: 0.170764 Aug 24 11:27:24.378691 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 82/148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:24 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:24.427151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:24.427742 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:24.434856 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.435340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.435801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.436506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.436964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.437421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.590144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:24.599139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2e0c1f8e-0949-45ba-8f4a-892421787ad3 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.177004 Aug 24 11:27:24.599745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 67/149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:24 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:24.898354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:24.898962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:24.908656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.909141 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.909599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.910289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.910749 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.911157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.967692 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:24.968744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:24.975381 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.976056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.976597 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.977876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:24.978020 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:24.978506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:24.993693 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:25.002212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c29cf5a2-f0fd-4a4d-bf25-0c91124f1ced tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1272 microversion: 2.1 time: 0.108198 Aug 24 11:27:25.002902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 83/150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:24 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:25.130290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:25.139226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b3490e0-f2d6-4887-95ee-0fbe245e0b28 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.175408 Aug 24 11:27:25.139804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 68/151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:24 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:25.399378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:25.399882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:25.405848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.406323 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.406753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.407434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.407881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.408297 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.538825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:25.547819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c609690a-4fda-4c77-9fa6-dc6fad35510f tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1555 microversion: 2.1 time: 0.153205 Aug 24 11:27:25.548399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 84/152] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:25 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:25.621086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:25.621713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:25.627677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.628161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.628590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.629304 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.629750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.630165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.774908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:25.782666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e55b308b-271b-4e9a-997f-3b8f273a3e98 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.165994 Aug 24 11:27:25.783229 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 69/153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:25 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:26.024109 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:26.024704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:26.030993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.031467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.031889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.032571 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.033015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.033484 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.096695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:26.104882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd23723b-c099-4555-bfef-c0dcb407d144 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1272 microversion: 2.1 time: 0.084772 Aug 24 11:27:26.105485 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 85/154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:26 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:26.164595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:26.165228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:26.171519 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.172004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.172436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.173190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.173666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.174090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.311672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:26.319585 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57cad525-fae5-4b90-9568-ae0c8e56b083 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.159536 Aug 24 11:27:26.320140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 70/155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:26 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:26.567996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:26.568511 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:26.574497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.574985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.575424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.576106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.576562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.576985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.706274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:26.715095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ea4a89b-ed07-4c56-9e7b-49a44a6e96f9 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1555 microversion: 2.1 time: 0.151054 Aug 24 11:27:26.715697 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 86/156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:26 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:26.803131 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:26.803847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:26.810149 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.810629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.811054 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.811736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.812181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.812598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.943160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:26.951568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca8a33c3-694d-4678-b999-2770b38fa5a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.152351 Aug 24 11:27:26.952132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 71/157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:26 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:27.126118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:27.126664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.134504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.134976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.135400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.136078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.136546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.136959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.200811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:27.208668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-328e522e-0762-4025-930f-f633d1d652f3 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1272 microversion: 2.1 time: 0.086432 Aug 24 11:27:27.209414 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 87/158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:27 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:27.340402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:27.341321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.348823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.349357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.349830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.350556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.351038 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.352116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.568075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:27.577734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2dc81e40-7c02-4ea4-8d53-09d19225e5e3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.241588 Aug 24 11:27:27.578323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 72/159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:27 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:27.735492 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:27.736102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.744289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.745049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.745663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.746695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.747111 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.747693 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.904528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:27.914037 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8684f35f-f3bb-4ecd-a2b2-e5bd3fd1718a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1555 microversion: 2.1 time: 0.182289 Aug 24 11:27:27.914523 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 88/160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:27 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:27.993904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:27.994599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.002725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.003210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.003638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.004321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.004766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.005479 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.038250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1495893699", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "networks": [{"uuid": "42784ad8-e769-45bf-bea9-79cb53cd9cca"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:28.101756 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] validate_networks() for [('42784ad8-e769-45bf-bea9-79cb53cd9cca', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:28.247002 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:28.255270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-374b34a1-6088-4d9c-8599-88cb8f5dabb8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.267237 Aug 24 11:27:28.255932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 73/161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:27 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:28.264224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:28.265047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.273194 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.273816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.274329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.275100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.275659 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.276091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.510176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:28.514131 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:28.519733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dade57d3-ae72-44c6-b1fa-f38fc64a623c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.261400 Aug 24 11:27:28.520513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 74/162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:28 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:28.549534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:28.550038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:28.550589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:28.551068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:28.551544 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:28.562539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.563145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.563652 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.564589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.565230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.565963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.590233 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Getting quotas for project c968349e73bf45f48fdc00ba42989d8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:28.599358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:28.600523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.607316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Getting quotas for user 9c69e150421e412384d055f51eb71868 and project c968349e73bf45f48fdc00ba42989d8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:28.608924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.609536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.610588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.613438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.614139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.614580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.625909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:28.629456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:28.691198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c111681-81fd-497d-b89a-be101697d3e2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657794 Aug 24 11:27:28.691198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 89/163] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:27:28.702475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1360b713-0ec0-46eb-b088-ff57b24d81f7 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:28.703095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1360b713-0ec0-46eb-b088-ff57b24d81f7 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.818214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1360b713-0ec0-46eb-b088-ff57b24d81f7 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:28.830179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1360b713-0ec0-46eb-b088-ff57b24d81f7 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1219 microversion: 2.1 time: 0.131464 Aug 24 11:27:28.845227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 90/164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:28 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:28.853928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:28.875171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:28.892890 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:28.904707 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4f5546c4-c84a-4421-9cce-18bba67f5e8e tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.309294 Aug 24 11:27:28.906273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 75/165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:28 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:28.937426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:28.938035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.948506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.951312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.952009 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.952891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.955227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.955869 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.006913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e24254f7-9991-4300-8160-19fe3a5cdae4 req-26ce6ddd-2a87-4d11-bb8c-1a2ba68fd1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9f35d2-0527-463d-b485-b996d06cdfda", "tag": "50bf3d77-40c6-45c9-9679-c8e3913a9c40"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:29.027944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e24254f7-9991-4300-8160-19fe3a5cdae4 req-26ce6ddd-2a87-4d11-bb8c-1a2ba68fd1bd service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.028423 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e24254f7-9991-4300-8160-19fe3a5cdae4 req-26ce6ddd-2a87-4d11-bb8c-1a2ba68fd1bd service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.028845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e24254f7-9991-4300-8160-19fe3a5cdae4 req-26ce6ddd-2a87-4d11-bb8c-1a2ba68fd1bd service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.052377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e24254f7-9991-4300-8160-19fe3a5cdae4 req-26ce6ddd-2a87-4d11-bb8c-1a2ba68fd1bd service nova] Creating event network-changed:50bf3d77-40c6-45c9-9679-c8e3913a9c40 for instance 4b9f35d2-0527-463d-b485-b996d06cdfda on hv-cinder-85427 Aug 24 11:27:29.058308 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e24254f7-9991-4300-8160-19fe3a5cdae4 req-26ce6ddd-2a87-4d11-bb8c-1a2ba68fd1bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055619 Aug 24 11:27:29.059206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 76/166] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:29.219959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:29.250743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dda59f90-f83f-4dbe-a5ae-7c4afc847735 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1555 microversion: 2.1 time: 0.317929 Aug 24 11:27:29.253342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 91/167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:28 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1555 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:29.282344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:29.294305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:29.317463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.327202 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.329653 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.336260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.337769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.339361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.476956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-99dbe613-4a38-4c68-b266-ba4af52dd2b7 req-62e63185-b0c8-4259-a235-2e6d7f64bc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841c3b38-934d-454d-8898-a48f3b0ec74b", "name": "network-vif-deleted", "tag": "2316946a-6bb4-4048-b0bb-23d086ed2b23"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:29.495405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-99dbe613-4a38-4c68-b266-ba4af52dd2b7 req-62e63185-b0c8-4259-a235-2e6d7f64bc8c service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.496727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-99dbe613-4a38-4c68-b266-ba4af52dd2b7 req-62e63185-b0c8-4259-a235-2e6d7f64bc8c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.497447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-99dbe613-4a38-4c68-b266-ba4af52dd2b7 req-62e63185-b0c8-4259-a235-2e6d7f64bc8c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.518790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-99dbe613-4a38-4c68-b266-ba4af52dd2b7 req-62e63185-b0c8-4259-a235-2e6d7f64bc8c service nova] Creating event network-vif-deleted:2316946a-6bb4-4048-b0bb-23d086ed2b23 for instance 841c3b38-934d-454d-8898-a48f3b0ec74b on hv-cinder-85427 Aug 24 11:27:29.525924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-99dbe613-4a38-4c68-b266-ba4af52dd2b7 req-62e63185-b0c8-4259-a235-2e6d7f64bc8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059920 Aug 24 11:27:29.528160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 92/168] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:29.546192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:29.546915 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:29.559400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.562282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.563332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.564505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.565692 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.567219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.627456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:29.637180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0df88f35-6563-4b4d-ab29-f008616a8f13 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.363229 Aug 24 11:27:29.645843 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 77/169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:29 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:29.765589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:29.774287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a7c1568-c30b-40db-a4d2-dad6c22296cd tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.236806 Aug 24 11:27:29.774861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 93/170] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:29 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:29.855657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:29.856156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:29.862886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.863464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.863930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.864625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.865068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.865560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.926698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:29.927440 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:29.928616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:29.933583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.934085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.934497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.935186 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.935628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.936038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.936190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-860f54f0-8508-4696-818d-e6cd13675804 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1223 microversion: 2.1 time: 0.084496 Aug 24 11:27:29.936761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 78/171] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:29 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:30.061282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:30.069608 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02ae3f55-239f-4a20-9885-598167d797b3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1314 microversion: 2.1 time: 0.145951 Aug 24 11:27:30.070193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 94/172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:29 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:30.293295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:30.295001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:30.308016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.308510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.311069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.311729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.312215 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.312654 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.401391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:30.409633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd627ca6-0253-4cb9-b7f2-2c69945bb637 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1346 microversion: 2.1 time: 0.122887 Aug 24 11:27:30.410202 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 79/173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:30 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:30.658809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:30.659413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:30.665899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.666383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.666815 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.667509 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.667957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.668382 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.795063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:30.795680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:30.801713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.802505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.803179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.803941 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.804667 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.805093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.820160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:30.824641 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:30.830619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97435d44-f19f-4c14-b425-c9d731ea7839 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.175772 Aug 24 11:27:30.831519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 95/174] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:30 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:30.943211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:30.951406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90d66fcd-1e8f-4394-ac87-d945034e1c44 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.160273 Aug 24 11:27:30.951972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 80/175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:30 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:30.957250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:30.957862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:30.964893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.965419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.965852 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.966546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.967026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.967443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.034495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:31.042466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f54e5d1f-47b4-46a7-afd9-6b537772fa72 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1271 microversion: 2.1 time: 0.089106 Aug 24 11:27:31.043060 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 96/176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:30 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:31.090233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.090764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.096685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.097157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.097613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.098289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.098731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.099144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.237093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:31.247458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a439d88f-4984-40c0-8632-e336a1bc5c37 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1463 microversion: 2.1 time: 0.161213 Aug 24 11:27:31.248153 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 81/177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:31.294799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.295293 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.301214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.301704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.302133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.303497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.303883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.304334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.329319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:27:31.398066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:31.404892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8da2801a-39ca-4cd5-8b96-91cd0be92672 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 204 len: 0 microversion: 2.1 time: 0.113708 Aug 24 11:27:31.405516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 97/178] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:27:31 2022] DELETE /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:27:31.414640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.415254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.421578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.422097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.422534 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.423224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.423679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.424102 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.432113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.432837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.439640 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.440131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.440560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.441277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.441728 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.442152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.472849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.473357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.473790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.474232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lazy-loading 'fault' on Instance uuid 841c3b38-934d-454d-8898-a48f3b0ec74b {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:31.519162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:31.527727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92cdce40-3200-4a35-8447-5ba1c2d4220a tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1351 microversion: 2.1 time: 0.100607 Aug 24 11:27:31.528299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 98/179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:31.558710 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:31.566260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b26dff2a-0c39-4b00-8bed-70bb4d9f6ee3 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1469 microversion: 2.1 time: 0.156309 Aug 24 11:27:31.566817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 82/180] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:31.854373 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.854972 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.861753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.862238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.862703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.863393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.863848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.864267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.972683 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.973323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.992520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.993022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.993620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.994435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.994910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.995336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.021045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:32.031942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6172a507-7f66-4f85-a09a-e6573fa38993 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.181285 Aug 24 11:27:32.032519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 99/181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:32.069128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:32.071213 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:32.077166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.077681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.078124 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.078822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.079274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.081685 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.134857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:32.142562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-486464e8-8809-4417-8158-17bf9e9a37d2 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.173697 Aug 24 11:27:32.143156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 83/182] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:32.152866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:32.164789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7844e972-9b59-48f5-a4bd-70d147868930 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1271 microversion: 2.1 time: 0.101344 Aug 24 11:27:32.177228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 100/183] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:32 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:32.548142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:32.548749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:32.556311 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.556788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.557240 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.557932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.558382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.558803 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.588277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:32.588881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:32.589560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.590049 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.590483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.590941 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lazy-loading 'fault' on Instance uuid 841c3b38-934d-454d-8898-a48f3b0ec74b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:32.594674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.595152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.595583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.596260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.596708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.597125 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.638416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:32.646863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9389ed5b-2fa1-42cf-b463-0365d95696c3 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1351 microversion: 2.1 time: 0.102444 Aug 24 11:27:32.647762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 84/184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:32 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:32.728630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:32.736352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1eba0b9b-99a3-4637-b59f-9934ba4b237a tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1469 microversion: 2.1 time: 0.151965 Aug 24 11:27:32.736918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 101/185] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:32 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:33.053736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:33.054343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:33.060496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.060992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.061470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.062168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.062656 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.063083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.164521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:33.165133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:33.180960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.181497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.181939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.182655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.183110 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.183540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.212724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.221133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e96eaa2-d39f-436d-9cdd-8799ac9331f9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.171817 Aug 24 11:27:33.221905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 85/186] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:33 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:33.227235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:33.227762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:33.236008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.236008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.236008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.236660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.237106 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.237626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.302811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.312375 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7dbea37d-c010-4200-9f2f-2ecc4a3464ac tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1279 microversion: 2.1 time: 0.089450 Aug 24 11:27:33.313156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 86/187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:33 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:33.337047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.345035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2c940e3-8842-4b64-9dd0-1ba4f42366a1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.184975 Aug 24 11:27:33.345636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 102/188] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:33 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:33.668553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:33.669339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:33.676200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.676771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.677287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.678755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.679465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.679900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.712658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.713147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.714230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.714887 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lazy-loading 'fault' on Instance uuid 841c3b38-934d-454d-8898-a48f3b0ec74b {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:33.760958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640a850f8a7d461aa7bfed45d14e41e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966dbb1de9c42c2a765c655104e7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.763278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:33.764403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:33.770690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ebaa06b-7e40-4b00-b3f9-1ba85fcb52ec tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 200 len: 1351 microversion: 2.1 time: 0.105886 Aug 24 11:27:33.772117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 87/189] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:33 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:33.774591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.775306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.775736 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.776540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.777181 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.777767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.931425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.939092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6ca31a9-0077-4fae-a86b-263185ff5f97 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1469 microversion: 2.1 time: 0.184907 Aug 24 11:27:33.939661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 103/190] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:33 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:34.248579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.251821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.258988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.259703 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.260188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.261015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.261625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.262053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.334548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.335952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.348655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.351664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.351664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.351664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.352007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.352261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.434229 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:34.435666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:34.442713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-12fec73a-a6d0-4888-8b06-bb3f6a851782 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.198295 Aug 24 11:27:34.449982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5c34d0e-e90a-4ac6-9c42-a24ee3676b83 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1289 microversion: 2.1 time: 0.119842 Aug 24 11:27:34.464405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 88/191] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:34.465079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 104/192] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1289 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:34.465178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.465178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.469237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.469739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.470178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.470879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.471331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.471757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.798975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.799995 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.808177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.808577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.809006 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.809740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.810191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.810607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.827820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] HTTP exception thrown: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Request method failure captured: Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b HTTP/1.1 Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrZtuhf1d_JEHp8HiX-LvUVYKi4SbQwy3p1LkI-fbJ8J65uGLo7thAHt6r0ELqO-Dlm0vaUQ5zW55oBa5qJSmfX0wzcO8kfZPki4E7Q42eTPe32Rb6PysPIYdVKgEEi1ijFlst_XJsiDQ7TgcpVlCozSD0306fyCrcJNtfSzhXWD7U Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:27:34.836228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 640a850f8a7d461aa7bfed45d14e41e0 Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:34.838941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '841c3b38-934d-454d-8898-a48f3b0ec74b'} Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:34.840886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:34.844917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:34.850722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Returning 404 to user: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:34.850722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3a65069-efa1-49f5-94aa-ead00e085851 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 404 len: 111 microversion: 2.1 time: 0.043774 Aug 24 11:27:34.853149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 105/193] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:27:34.969247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.973244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.983625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.984603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.985437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.987285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.988324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.989094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.109359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:35.120098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8cdf58df-ab93-4b40-9f35-f5ce59688e16 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.661517 Aug 24 11:27:35.121608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 89/194] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:35.127442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:35.132270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:35.140565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.141402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.142013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.142930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.144045 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.144724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.161409 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] HTTP exception thrown: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Request method failure captured: Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b/os-volume_attachments HTTP/1.1 Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrZtuhf1d_JEHp8HiX-LvUVYKi4SbQwy3p1LkI-fbJ8J65uGLo7thAHt6r0ELqO-Dlm0vaUQ5zW55oBa5qJSmfX0wzcO8kfZPki4E7Q42eTPe32Rb6PysPIYdVKgEEi1ijFlst_XJsiDQ7TgcpVlCozSD0306fyCrcJNtfSzhXWD7U Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:27:35.169338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 640a850f8a7d461aa7bfed45d14e41e0 Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:35.170611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'server_id': '841c3b38-934d-454d-8898-a48f3b0ec74b'} Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:35.171260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:35.172296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:35.175265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Returning 404 to user: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:35.176462 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-849b2c1c-3fad-4b98-8b2a-3876e77543cb tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053656 Aug 24 11:27:35.177070 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 90/195] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:27:35 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:27:35.221986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:35.238339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1c72d58-c604-4e86-a4d1-a43211cd5962 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1469 microversion: 2.1 time: 0.280583 Aug 24 11:27:35.253230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 106/196] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:35.466212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:35.470019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:35.471643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:35.472987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:35.480678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.481537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.481648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.482093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.482595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.482896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.483441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.483891 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.484229 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.484332 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.484967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.485751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.723697 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:35.741159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0937d899-2b06-4e08-8d88-2cd2e904d9ff tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.273111 Aug 24 11:27:35.742820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 107/197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:35 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:35.761250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:35.776755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9841c368-af17-4334-9357-dc31c19c7403 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.312470 Aug 24 11:27:35.778713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 91/198] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:35 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:35.891802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-97504fb1-4eee-4d89-9801-f562f9067300 req-e1136e20-95c9-441d-98cc-94579448840e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9f35d2-0527-463d-b485-b996d06cdfda", "name": "network-vif-plugged", "status": "completed", "tag": "50bf3d77-40c6-45c9-9679-c8e3913a9c40"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:35.912846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-97504fb1-4eee-4d89-9801-f562f9067300 req-e1136e20-95c9-441d-98cc-94579448840e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.916708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-97504fb1-4eee-4d89-9801-f562f9067300 req-e1136e20-95c9-441d-98cc-94579448840e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.917253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-97504fb1-4eee-4d89-9801-f562f9067300 req-e1136e20-95c9-441d-98cc-94579448840e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.941906 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-97504fb1-4eee-4d89-9801-f562f9067300 req-e1136e20-95c9-441d-98cc-94579448840e service nova] Creating event network-vif-plugged:50bf3d77-40c6-45c9-9679-c8e3913a9c40 for instance 4b9f35d2-0527-463d-b485-b996d06cdfda on hv-cinder-85427 Aug 24 11:27:35.951104 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-97504fb1-4eee-4d89-9801-f562f9067300 req-e1136e20-95c9-441d-98cc-94579448840e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062991 Aug 24 11:27:35.956203 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 108/199] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:36.007878 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d1f840ce-09d0-4aeb-ad19-6b1473a30be5 req-f027e708-77f9-4f2d-8983-8fd120b746c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b457f94c-cdcd-4a31-86ad-995c96ae4d8f", "name": "network-vif-deleted", "tag": "5869cb0b-341f-4fe3-a140-ab76849cc0c6"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:36.021596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d1f840ce-09d0-4aeb-ad19-6b1473a30be5 req-f027e708-77f9-4f2d-8983-8fd120b746c8 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.022457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d1f840ce-09d0-4aeb-ad19-6b1473a30be5 req-f027e708-77f9-4f2d-8983-8fd120b746c8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.023237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d1f840ce-09d0-4aeb-ad19-6b1473a30be5 req-f027e708-77f9-4f2d-8983-8fd120b746c8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.029136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:36.050966 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d1f840ce-09d0-4aeb-ad19-6b1473a30be5 req-f027e708-77f9-4f2d-8983-8fd120b746c8 service nova] Creating event network-vif-deleted:5869cb0b-341f-4fe3-a140-ab76849cc0c6 for instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f on hv-cinder-85427 Aug 24 11:27:36.062198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d1f840ce-09d0-4aeb-ad19-6b1473a30be5 req-f027e708-77f9-4f2d-8983-8fd120b746c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058346 Aug 24 11:27:36.063999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 92/200] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:36.155168 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.156055 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.163183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.164138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.168468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.169746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.170370 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.170953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.270256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.271209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.280961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.280961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.280961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.280961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.281456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.281456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.390724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:36.412143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2dfb3069-38b6-4a74-8eac-de37c7f6da50 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1299 microversion: 2.1 time: 0.146690 Aug 24 11:27:36.414369 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 93/201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:36 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:36.454142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:36.465306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fdcae43-495e-4e5d-a238-347065ecab3e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.314746 Aug 24 11:27:36.465964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 109/202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:36 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:36.504114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.504957 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.505315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-391de23a-c0ff-42b7-9397-f9758f44ea35 req-735a6de3-2dfa-4c3a-9e3d-70ab2630f2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec67fbd5-125b-44eb-9a5c-170f31422b67", "tag": "9487eec8-02d0-4e5a-95f5-fd557fc4fc8f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:36.515918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-391de23a-c0ff-42b7-9397-f9758f44ea35 req-735a6de3-2dfa-4c3a-9e3d-70ab2630f2c0 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.516115 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.516391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-391de23a-c0ff-42b7-9397-f9758f44ea35 req-735a6de3-2dfa-4c3a-9e3d-70ab2630f2c0 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.516910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.517068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-391de23a-c0ff-42b7-9397-f9758f44ea35 req-735a6de3-2dfa-4c3a-9e3d-70ab2630f2c0 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.517696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.518904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.520087 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.520831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.531967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-391de23a-c0ff-42b7-9397-f9758f44ea35 req-735a6de3-2dfa-4c3a-9e3d-70ab2630f2c0 service nova] Creating event network-changed:9487eec8-02d0-4e5a-95f5-fd557fc4fc8f for instance ec67fbd5-125b-44eb-9a5c-170f31422b67 on hv-cinder-85427 Aug 24 11:27:36.537837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-391de23a-c0ff-42b7-9397-f9758f44ea35 req-735a6de3-2dfa-4c3a-9e3d-70ab2630f2c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035997 Aug 24 11:27:36.538709 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 110/203] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:36.550450 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] HTTP exception thrown: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Request method failure captured: Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b HTTP/1.1 Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrZtuhf1d_JEHp8HiX-LvUVYKi4SbQwy3p1LkI-fbJ8J65uGLo7thAHt6r0ELqO-Dlm0vaUQ5zW55oBa5qJSmfX0wzcO8kfZPki4E7Q42eTPe32Rb6PysPIYdVKgEEi1ijFlst_XJsiDQ7TgcpVlCozSD0306fyCrcJNtfSzhXWD7U Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:27:36.553135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 640a850f8a7d461aa7bfed45d14e41e0 Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.554779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '841c3b38-934d-454d-8898-a48f3b0ec74b'} Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:36.555605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.556797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.558098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Returning 404 to user: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:36.558098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bbb5f946-51f1-4e70-af49-b20bc349a787 tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "DELETE /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 404 len: 111 microversion: 2.1 time: 0.058065 Aug 24 11:27:36.558098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 94/204] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:27:36 2022] DELETE /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:27:36.564262 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.564967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] [instance: 841c3b38-934d-454d-8898-a48f3b0ec74b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.575890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.576386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.576825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.577611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.578067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.578490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.592840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] HTTP exception thrown: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Request method failure captured: Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b HTTP/1.1 Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrZtuhf1d_JEHp8HiX-LvUVYKi4SbQwy3p1LkI-fbJ8J65uGLo7thAHt6r0ELqO-Dlm0vaUQ5zW55oBa5qJSmfX0wzcO8kfZPki4E7Q42eTPe32Rb6PysPIYdVKgEEi1ijFlst_XJsiDQ7TgcpVlCozSD0306fyCrcJNtfSzhXWD7U Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:27:36.594516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1966dbb1de9c42c2a765c655104e7231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 1966dbb1de9c42c2a765c655104e7231 Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-184691787 Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 640a850f8a7d461aa7bfed45d14e41e0 Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-184691787-project Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.595876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '841c3b38-934d-454d-8898-a48f3b0ec74b'} Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:36.596543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. Aug 24 11:27:36.597863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:27:36.598796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] Returning 404 to user: Instance 841c3b38-934d-454d-8898-a48f3b0ec74b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:36.598796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f086de1a-6d2e-4859-bcb9-4a8c27b4643c tempest-DeleteServersTestJSON-184691787 tempest-DeleteServersTestJSON-184691787-project] 10.222.0.17 "GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b" status: 404 len: 111 microversion: 2.1 time: 0.035864 Aug 24 11:27:36.598796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 111/205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:36 2022] GET /compute/v2.1/servers/841c3b38-934d-454d-8898-a48f3b0ec74b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:27:36.763807 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.764425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.770682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.771177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.772245 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.772960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.773474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.773898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.802122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.804392 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.818131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.819490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.820269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.822413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.824702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.826841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.949460 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:36.962562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-366e7f07-2cb0-46d3-876c-ece604c5079e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.202300 Aug 24 11:27:36.964763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 95/206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:36 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:37.195722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:37.210870 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-97c120df-a880-4b23-88e6-1826fe96d128 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.413893 Aug 24 11:27:37.211452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 112/207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:36 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:37.436052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:37.436787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:37.443680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.444184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.444632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.445378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.445810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.446393 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.483823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.484305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.484733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.485178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lazy-loading 'fault' on Instance uuid b457f94c-cdcd-4a31-86ad-995c96ae4d8f {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:37.486695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:37.487301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:37.494061 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.494538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.494981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.495970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.496421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.497080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.503032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:37.534906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aaf6e3151db455ca8d4b4bfcc6a7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d9abd2149f43d38bad58f44b4ce033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:37.548717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec0e6ee9-1b73-411f-9567-47c1d5a3dcf0 tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 200 len: 1304 microversion: 2.1 time: 0.116992 Aug 24 11:27:37.549530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 96/208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:37 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:37.714774 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:37.724303 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99b473d2-f601-4534-a96a-e556bf1af274 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1314 microversion: 2.1 time: 0.241252 Aug 24 11:27:37.725809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 113/209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:37 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:37.995935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:37.996953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.004551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.005328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.008867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.011380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.012147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.012827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.238049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:38.239424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.250313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.251127 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.252244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.253715 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.254710 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.255649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.317119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:38.329671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd719e48-b5bb-40a1-a53d-b664287d141d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.343340 Aug 24 11:27:38.330885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 97/210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:37 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:38.556406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:38.564425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-059d7671-d676-4c33-82d3-7ce14c22490a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.331405 Aug 24 11:27:38.570752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:38.571429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] [instance: b457f94c-cdcd-4a31-86ad-995c96ae4d8f] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.574687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 114/211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:38 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:38.578193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.578749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.579188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.579985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.580495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.580940 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.597852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] HTTP exception thrown: Instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f could not be found. Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Request method failure captured: Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f HTTP/1.1 Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgsLL92UCIGvwjK0gx9vSm_JD-LTYs5IPy2A_A7t-WV1gHK0SDtdKjvxXUkY_eObf7YAqnM2adHv9V29bcT9kbRwQDnfT1052NVJKhP5zoRmUlNcsjy9VXl7i8gGdNJ4_M1iRjnkIW2fyq7l-9VkCt4o8EPnwlslTqYHqVafjZTKEpE Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 92d9abd2149f43d38bad58f44b4ce033 Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-346306429 Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:27:38.599362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92d9abd2149f43d38bad58f44b4ce033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92d9abd2149f43d38bad58f44b4ce033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92d9abd2149f43d38bad58f44b4ce033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92d9abd2149f43d38bad58f44b4ce033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-346306429 Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 92d9abd2149f43d38bad58f44b4ce033 Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-346306429 Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-346306429-project Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 1aaf6e3151db455ca8d4b4bfcc6a7159 Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-346306429-project Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f could not be found. Aug 24 11:27:38.601983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'b457f94c-cdcd-4a31-86ad-995c96ae4d8f'} Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f could not be found. Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:38.602779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f could not be found. Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f could not be found. Aug 24 11:27:38.604164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:38.605331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] Returning 404 to user: Instance b457f94c-cdcd-4a31-86ad-995c96ae4d8f could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:38.605331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d437ecf2-46ef-4b02-b091-501fa1da069d tempest-VolumesNegativeTest-346306429 tempest-VolumesNegativeTest-346306429-project] 10.222.0.17 "GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f" status: 404 len: 111 microversion: 2.1 time: 0.035026 Aug 24 11:27:38.605331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 98/212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:38 2022] GET /compute/v2.1/servers/b457f94c-cdcd-4a31-86ad-995c96ae4d8f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:27:38.753977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:38.755568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.760737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:38.775577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.776082 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.776532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.779866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.780273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.780810 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.827255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:39.330225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:39.361453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24b8569d-a769-45af-bf24-5824e61bed5a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1498 microversion: 2.1 time: 0.615956 Aug 24 11:27:39.362080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:39.363591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:39.372674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.373572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.374513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.375501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.376160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.376776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.378421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 115/213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:38 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1498 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:39.586530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:39.587467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:39.595763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.598591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.599891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.602736 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.603498 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.605245 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.747358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:39.760070 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-afc3a539-b995-4ef4-ba75-f0c56a31f229 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.408333 Aug 24 11:27:39.778210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 99/214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:39 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:40.048074 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:40.075955 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23401ec8-76d6-461e-b891-970e4d68f493 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.493728 Aug 24 11:27:40.097635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 116/215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:39 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:40.315325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:40.316885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:40.330058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.330737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.331682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.333960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.333960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.334841 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.376996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:27:40.547609 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16fcf981-0c5b-46d3-a4f6-11774f370a17 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 204 len: 0 microversion: 2.1 time: 0.244759 Aug 24 11:27:40.550039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 100/216] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:27:40 2022] DELETE /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:27:40.557982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:40.558597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:40.564910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.565455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.565901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.575023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.575568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.576005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.783267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:40.784051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:40.794337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.794840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.795468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.796203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.796657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.797075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.953811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:40.964664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f52c570c-a1e0-4427-a8b5-f7ac9e092c6c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1504 microversion: 2.1 time: 0.410574 Aug 24 11:27:40.965276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 117/217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:40 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:41.003652 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:41.014962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-10b49899-7000-4cc3-949d-f3d996c1ab41 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.236259 Aug 24 11:27:41.015657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 101/218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:40 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:41.096345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:41.097242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:41.108896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.109737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.110423 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.114162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.114906 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.115570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.374480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:41.386046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba511c21-b38d-4f37-99b3-01252eb80b97 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.293724 Aug 24 11:27:41.397963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 118/219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:41 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:41.989576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:41.990850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:41.997629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.998352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.998935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.999794 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.000389 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.000944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.042080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:42.042688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:42.049237 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.049934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.055152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.055917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.056387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.056812 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.317515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:42.345056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d469a5c-cddc-4f14-a6d0-85121c683719 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.307848 Aug 24 11:27:42.345698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 119/220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:42 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:42.410217 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:42.411628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:42.413136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:42.419513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.420191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.420789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.421707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.422320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.422467 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e81f2eb-cf8d-4d5d-ad52-886ecdb93a77 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1504 microversion: 2.1 time: 0.436781 Aug 24 11:27:42.423314 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.434536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 102/221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:41 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:42.627664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:42.640799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-647fbcd9-f968-4998-b926-462b1c0889fd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.232602 Aug 24 11:27:42.642608 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 120/222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:42 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:43.371904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:43.371904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:43.378644 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.379590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.379758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.381414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.381871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.382739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.463501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:43.467420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:43.495048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.495547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.495992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.496701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.497157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.497661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.634066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:43.659230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad08d6fd-228a-41df-9529-11eef0662c94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.292395 Aug 24 11:27:43.664821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 103/223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:43 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:43.675888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:43.676548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:43.688176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:43.695775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.696430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.696874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.697659 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.698065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1160b88-209f-4f12-999c-9ffa4f153d88 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1504 microversion: 2.1 time: 0.250143 Aug 24 11:27:43.698180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.698513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.699543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 121/224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:43 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:43.949639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:43.959793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8499bee-0642-4efa-b153-a8109e67443d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.293593 Aug 24 11:27:43.960377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 104/225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:43 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:44.423582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-94e30f3a-5cf4-4a91-a5c7-7d1d42ef1201 req-9cfaafde-3814-4b12-9d5d-f54e08720310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9f35d2-0527-463d-b485-b996d06cdfda", "name": "network-vif-deleted", "tag": "50bf3d77-40c6-45c9-9679-c8e3913a9c40"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:44.435816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-94e30f3a-5cf4-4a91-a5c7-7d1d42ef1201 req-9cfaafde-3814-4b12-9d5d-f54e08720310 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.436304 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-94e30f3a-5cf4-4a91-a5c7-7d1d42ef1201 req-9cfaafde-3814-4b12-9d5d-f54e08720310 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.437298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-94e30f3a-5cf4-4a91-a5c7-7d1d42ef1201 req-9cfaafde-3814-4b12-9d5d-f54e08720310 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.455581 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-94e30f3a-5cf4-4a91-a5c7-7d1d42ef1201 req-9cfaafde-3814-4b12-9d5d-f54e08720310 service nova] Creating event network-vif-deleted:50bf3d77-40c6-45c9-9679-c8e3913a9c40 for instance 4b9f35d2-0527-463d-b485-b996d06cdfda on hv-cinder-85427 Aug 24 11:27:44.464120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-94e30f3a-5cf4-4a91-a5c7-7d1d42ef1201 req-9cfaafde-3814-4b12-9d5d-f54e08720310 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045522 Aug 24 11:27:44.465307 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 122/226] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:44.681603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:44.682204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:44.688620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.689351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.689927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.690760 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.691369 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.691933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.730664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:44.732831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:44.747824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.753183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.754045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.755481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.757235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.758431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.800495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.800973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.801469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.801915 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lazy-loading 'fault' on Instance uuid 4b9f35d2-0527-463d-b485-b996d06cdfda {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:44.882858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:44.895809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c94b1253-809e-4f63-b960-a666df214bb7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 200 len: 1304 microversion: 2.1 time: 0.177886 Aug 24 11:27:44.897750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 123/227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:44 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:44.921839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:44.934341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d425c46-33f1-4a8e-b52e-2c89bedc4d3d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.257599 Aug 24 11:27:44.935373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 105/228] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:44 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:44.983420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:44.983583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:44.994718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.995238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.995915 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.998596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.999264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.999705 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.316553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:45.329961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16fbb55a-3b7f-4e5a-9ae8-bc9283c37fd2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.350910 Aug 24 11:27:45.331109 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 124/229] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:44 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:45.924590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:45.929221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 4b9f35d2-0527-463d-b485-b996d06cdfda] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:45.937116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.938526 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.939231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.940191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.941486 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.942785 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.970246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] HTTP exception thrown: Instance 4b9f35d2-0527-463d-b485-b996d06cdfda could not be found. Aug 24 11:27:45.970458 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:45.971625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Request method failure captured: Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda HTTP/1.1 Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgsUy9j9t3Gi1Gme8p92D8t7WS4i50osFntoKfXAj1lVpyRnMSVL7dQgbT6shiFNblc9btMHJadH41Ou1V8-LH0NAslsRx3XOiW_ytxNiscbWM-NyqgVgEvzn6tAI2URgs0hJs6rEn0vXMJsuZt4CR2PunR-HV8VGrqooSWR8EeNVXY Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 30257baa3ace4435bda61ac02eaf78a5 Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesActionsTest-234368323 Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:27:45.979871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesActionsTest-234368323 Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 30257baa3ace4435bda61ac02eaf78a5 Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesActionsTest-234368323 Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesActionsTest-234368323-project Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 061e7f9c27e34122959fed8e48de95a3 Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesActionsTest-234368323-project Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 4b9f35d2-0527-463d-b485-b996d06cdfda could not be found. Aug 24 11:27:45.982177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '4b9f35d2-0527-463d-b485-b996d06cdfda'} Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9f35d2-0527-463d-b485-b996d06cdfda could not be found. Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:45.983279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9f35d2-0527-463d-b485-b996d06cdfda could not be found. Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9f35d2-0527-463d-b485-b996d06cdfda could not be found. Aug 24 11:27:45.985059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:27:45.987142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.987142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.987142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.987393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.988553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.988717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.991211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Returning 404 to user: Instance 4b9f35d2-0527-463d-b485-b996d06cdfda could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:45.992425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a098b45d-d3fd-4881-9af8-82d407b1554c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda" status: 404 len: 111 microversion: 2.1 time: 0.071820 Aug 24 11:27:45.993784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 106/230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:45 2022] GET /compute/v2.1/servers/4b9f35d2-0527-463d-b485-b996d06cdfda => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:27:46.159795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f9b32ccd-6bd2-4d9b-8048-6256b9f3c4f1 req-90b1f8fe-30d1-4839-ba3c-ad5a79ff6a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec67fbd5-125b-44eb-9a5c-170f31422b67", "name": "network-vif-plugged", "status": "completed", "tag": "9487eec8-02d0-4e5a-95f5-fd557fc4fc8f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:46.179395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9b32ccd-6bd2-4d9b-8048-6256b9f3c4f1 req-90b1f8fe-30d1-4839-ba3c-ad5a79ff6a49 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.179893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9b32ccd-6bd2-4d9b-8048-6256b9f3c4f1 req-90b1f8fe-30d1-4839-ba3c-ad5a79ff6a49 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.181302 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f9b32ccd-6bd2-4d9b-8048-6256b9f3c4f1 req-90b1f8fe-30d1-4839-ba3c-ad5a79ff6a49 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.199077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f9b32ccd-6bd2-4d9b-8048-6256b9f3c4f1 req-90b1f8fe-30d1-4839-ba3c-ad5a79ff6a49 service nova] Creating event network-vif-plugged:9487eec8-02d0-4e5a-95f5-fd557fc4fc8f for instance ec67fbd5-125b-44eb-9a5c-170f31422b67 on hv-cinder-85427 Aug 24 11:27:46.206697 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f9b32ccd-6bd2-4d9b-8048-6256b9f3c4f1 req-90b1f8fe-30d1-4839-ba3c-ad5a79ff6a49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050764 Aug 24 11:27:46.207922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 107/231] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:46.215025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2051647981", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "networks": [{"uuid": "c04bc0a8-c5c3-4b5a-9b71-ff07b68fa5b2"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:46.355912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] validate_networks() for [('c04bc0a8-c5c3-4b5a-9b71-ff07b68fa5b2', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:46.357841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:46.373304 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d3dbb45-4793-473b-8d45-cdd807a68aaf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.411030 Aug 24 11:27:46.374070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 125/232] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:45 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:46.385228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:46.389954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:46.409858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.411541 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.412247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.413100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.413625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.414056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.699489 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:46.718234 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7f94246-debc-4825-a92b-1f00262daf1c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.341532 Aug 24 11:27:46.719215 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 126/233] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:46 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:46.930189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:46.930877 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:46.931654 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:46.932329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:46.933062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:46.943094 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:46.952845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.953522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.953792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.954882 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.955655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.956612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.987710 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Getting quotas for project 30257baa3ace4435bda61ac02eaf78a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:46.992541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Getting quotas for user 061e7f9c27e34122959fed8e48de95a3 and project 30257baa3ace4435bda61ac02eaf78a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:47.006176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:47.009109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:47.060307 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64f106cf-8a46-4975-b5b2-8f7d5247d0a8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850882 Aug 24 11:27:47.061261 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 108/234] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:27:47.078484 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3eb951d-489d-4706-a0cc-c1abe175f2a4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:47.079112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3eb951d-489d-4706-a0cc-c1abe175f2a4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:47.199706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3eb951d-489d-4706-a0cc-c1abe175f2a4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:47.207743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3eb951d-489d-4706-a0cc-c1abe175f2a4 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1214 microversion: 2.1 time: 0.133575 Aug 24 11:27:47.209512 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 127/235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:47 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:47.404306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:47.405251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:47.413007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.414047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.414960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.417523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.418302 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.419868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.742622 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:47.743488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:47.751311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.753689 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.754450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.756051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.756728 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.758596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.788847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:47.801743 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbecfd79-4e38-4cf1-8d1a-518cca9da61f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1319 microversion: 2.1 time: 0.405196 Aug 24 11:27:47.817560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 109/236] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:47 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:47.999931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:48.011762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13bf5d63-4081-470e-b9c2-017408383b5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.275260 Aug 24 11:27:48.012583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 128/237] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:47 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:48.248212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:48.251785 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:48.264136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.265659 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.266751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.268220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.269434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.270348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.367120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:48.373366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:48.376083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33c4b90e-0df3-4ee3-9e5e-f4d61c77ccd7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1210 microversion: 2.1 time: 0.139734 Aug 24 11:27:48.389711 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 110/238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:48 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:48.824723 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:48.825445 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:48.838512 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.839011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.839444 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.840154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.843214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.843719 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.034793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:49.035455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:49.057988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.059815 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.060339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.062558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.064156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.064596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.129920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:49.152617 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c68f3424-d336-43df-aff6-209affa076de tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1507 microversion: 2.1 time: 0.332383 Aug 24 11:27:49.154415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 129/239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:48 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:49.366323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:49.378948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9cb4b4cb-e24b-4fd3-8729-9a417332b0ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.349134 Aug 24 11:27:49.394868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 111/240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:49 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:49.401383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:49.402267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:49.422801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.423412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.424086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.427242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.428925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.429549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.533159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:49.548882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e55e362-defd-4943-8d1b-024048dd617f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1266 microversion: 2.1 time: 0.151390 Aug 24 11:27:49.549782 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 130/241] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:49 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:50.414055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:50.414839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:50.423746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.424253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.424779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.425515 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.425974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.426402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.572177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:50.572783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:50.579547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.580300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.580728 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.581449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.581897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.582312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.595604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:50.670315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:50.682865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-342831fe-fe85-4719-aa3b-601891eff6c6 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1272 microversion: 2.1 time: 0.115790 Aug 24 11:27:50.684436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 131/242] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:50 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:50.732714 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:50.749330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8441ee61-f2e3-4023-a04f-8c0f75776a39 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.342943 Aug 24 11:27:50.751771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 112/243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:50 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:51.140981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-066132c3-c11e-4fa2-915c-674f308dc867 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: .version_select at 0x7f5ba4a11b80>, body: {"keypair": {"name": "tempest-keypair-1045578153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAARXm8vKgFTYNGDNjVSehCkqliQ0t0RCaHlwzzosjOFvzZejvynyG2JjQTA+woZsoS1V0RR3/7eIXCfKIKhMxzxU+THvr2eSLCnsG7S/Ms0HnNV4iu7XqdviplfoSrz3g=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:51.165568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-066132c3-c11e-4fa2-915c-674f308dc867 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:51.172744 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-066132c3-c11e-4fa2-915c-674f308dc867 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for user 91a426581a984225a97d7f4d60380aba and project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:51.218137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-066132c3-c11e-4fa2-915c-674f308dc867 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273231 Aug 24 11:27:51.219445 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 132/244] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:27:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:51.711934 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:51.713080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:51.741031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.744135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.745090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.749104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.750027 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.750670 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.776619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:51.777634 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:51.784811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.785337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.785946 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.786873 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.787488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.788056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.113844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:52.130063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5d028b47-bcfe-4eed-9315-a11d10641bbb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.357676 Aug 24 11:27:52.137625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 133/245] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:51 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:52.237240 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:52.247871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-716704b5-bdae-49b0-99d2-572f5090f6ba tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.542282 Aug 24 11:27:52.253526 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 113/246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:51 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:52.335925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d4804bd0-2477-4265-a451-c397c8091374 req-c9f685ca-206e-428a-97fc-8eabff3afe1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818646e9-28d8-47c8-9e7d-c4bcd2baf4df", "tag": "3ecc3de1-f84c-4621-904b-0ac894f835a9"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:52.355376 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4804bd0-2477-4265-a451-c397c8091374 req-c9f685ca-206e-428a-97fc-8eabff3afe1c service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.356014 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4804bd0-2477-4265-a451-c397c8091374 req-c9f685ca-206e-428a-97fc-8eabff3afe1c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.361391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d4804bd0-2477-4265-a451-c397c8091374 req-c9f685ca-206e-428a-97fc-8eabff3afe1c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.377242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d4804bd0-2477-4265-a451-c397c8091374 req-c9f685ca-206e-428a-97fc-8eabff3afe1c service nova] Creating event network-changed:3ecc3de1-f84c-4621-904b-0ac894f835a9 for instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df on hv-cinder-85427 Aug 24 11:27:52.386049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d4804bd0-2477-4265-a451-c397c8091374 req-c9f685ca-206e-428a-97fc-8eabff3afe1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057651 Aug 24 11:27:52.387255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 134/247] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:53.151791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:53.153436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:53.182314 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.184797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.185513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.186898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.189642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.190504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.272190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:53.273613 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:53.293089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.293525 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.293959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.294678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.295130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.295555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.449809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:53.462568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-163449b0-ac35-49ff-aa43-5686701dcfcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.314932 Aug 24 11:27:53.473239 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 114/248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:53 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:53.473239 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1497982713", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f86f70a-fb12-4770-8c95-ad2a3c0607dd"}], "security_groups": [{"name": "tempest-securitygroup--718117828"}], "key_name": "tempest-keypair-1045578153", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:53.523920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:53.532332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c8e50c0-c66d-446e-b38c-2402f09edbd1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.266622 Aug 24 11:27:53.533049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 135/249] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:53 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:53.613758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] validate_networks() for [('1f86f70a-fb12-4770-8c95-ad2a3c0607dd', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:54.086013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:54.086639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:54.087123 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:54.087533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:54.088499 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:54.103004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.103500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.103932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.104973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.105465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.105896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.125618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:54.131223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for user 91a426581a984225a97d7f4d60380aba and project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:54.151752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:54.154280 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:54.259496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-64467651-1438-4543-bd78-89e319a56615 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.794141 Aug 24 11:27:54.262125 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 115/250] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:27:54.271812 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee3ed8ab-e182-430b-b314-4bc6752f18f8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:54.273403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee3ed8ab-e182-430b-b314-4bc6752f18f8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:54.396795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee3ed8ab-e182-430b-b314-4bc6752f18f8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:54.405006 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee3ed8ab-e182-430b-b314-4bc6752f18f8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1238 microversion: 2.1 time: 0.137425 Aug 24 11:27:54.415791 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 136/251] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:54 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1238 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:54.485666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:54.486638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:54.497050 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.511291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.511813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.513754 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.517110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.517689 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.560803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:54.561758 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:54.588344 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.589098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.589593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.590340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.590879 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.591222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.830715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:54.853312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5b79e0c5-2526-478c-b433-d760103b9f71 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.371752 Aug 24 11:27:54.853920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 116/252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:54 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:55.009857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:55.017841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdc23a52-96c9-4b93-ba18-215a700890e1 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.462049 Aug 24 11:27:55.032412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 137/253] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:54 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:55.431533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:55.432945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:55.452373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.453114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.453776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.455491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.456389 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.457185 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.611357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:55.629408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c6b9008e-8f2f-418b-af3a-f0680c281066 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1234 microversion: 2.1 time: 0.203176 Aug 24 11:27:55.630354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 117/254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:55 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1234 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:55.875679 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:55.876349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:55.879353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:55.883983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.884515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.884937 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.885698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.886175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.886603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.042990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:56.043955 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:56.051868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.053009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.053607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.054375 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.054839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.055274 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.060664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:56.071545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f242282-83b2-4566-9f26-875fca93ed07 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.199343 Aug 24 11:27:56.072486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 138/255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:55 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:56.225066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:56.234117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7934aeac-1c9f-46e2-888d-e0674512c35f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.197697 Aug 24 11:27:56.234713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 118/256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:56 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:56.657544 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:56.658323 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:56.666190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.666720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.667192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.667867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.668325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.668793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.734260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:56.743556 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28c3fc74-fd8c-46c6-bdd4-fe5436858b87 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1290 microversion: 2.1 time: 0.090205 Aug 24 11:27:56.744603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 139/257] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:56 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:57.097324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:57.098160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:57.109430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.109959 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.110400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.113126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.113126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.113126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.259271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:57.259892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:57.266949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.267379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.267577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.268292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.268743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.269159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.270329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:57.279616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3dc3a1ef-116c-48c6-8e3e-ebbd5b5ffa06 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1521 microversion: 2.1 time: 0.186685 Aug 24 11:27:57.280216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 119/258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:57 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:57.427577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:57.436109 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60d4eec7-f4ba-401f-9db2-ecef488947d8 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.181887 Aug 24 11:27:57.436775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 140/259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:57 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:57.766152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:57.766767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:57.774303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.774718 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.775191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.775898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.776353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.776779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.869728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:57.878819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f578d126-5ffd-40ff-9765-c1a43e2cb8bf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1296 microversion: 2.1 time: 0.116413 Aug 24 11:27:57.879415 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 120/260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:57 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:58.307092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:58.309028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:58.319781 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.319781 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.320232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.320916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.321473 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.322066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.474733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:58.475941 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:58.487537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.488310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.489566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.492184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.494498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.495697 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.629296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:58.656945 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ab93dffe-255f-4809-bc93-e18bc52359b8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1501 microversion: 2.1 time: 0.356552 Aug 24 11:27:58.673245 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 141/261] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:58 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:58.707051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:58.709568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:58.737151 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.737386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:58.740110 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.740967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.749025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ec31019c-0f62-4cac-8b00-71b054fc24b0 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.291405 Aug 24 11:27:58.751956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.754477 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 121/262] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:58 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:58.756681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.757642 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.909399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:58.911249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:58.921917 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.922545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.922962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.924063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.924523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.925124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:59.010685 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:59.026155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-568c3147-d3b9-45fa-bd14-896981b01451 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1515 microversion: 2.1 time: 0.347341 Aug 24 11:27:59.027766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 142/263] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:58 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:59.215250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:59.237667 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-88e7f8ff-d447-435e-8b85-e6b184def657 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.333118 Aug 24 11:27:59.252097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 122/264] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:58 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:59.777836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:59.778529 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:59.786656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:59.787591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:59.788227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:59.789139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:59.789868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:59.790431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.002696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-acd5590b-df8b-4c30-8e43-4bb599bd3598 req-e3762c35-7b5e-4306-a653-364e04719914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818646e9-28d8-47c8-9e7d-c4bcd2baf4df", "name": "network-vif-plugged", "status": "completed", "tag": "3ecc3de1-f84c-4621-904b-0ac894f835a9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:00.015730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-acd5590b-df8b-4c30-8e43-4bb599bd3598 req-e3762c35-7b5e-4306-a653-364e04719914 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.016491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-acd5590b-df8b-4c30-8e43-4bb599bd3598 req-e3762c35-7b5e-4306-a653-364e04719914 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.017065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-acd5590b-df8b-4c30-8e43-4bb599bd3598 req-e3762c35-7b5e-4306-a653-364e04719914 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.033384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-acd5590b-df8b-4c30-8e43-4bb599bd3598 req-e3762c35-7b5e-4306-a653-364e04719914 service nova] Creating event network-vif-plugged:3ecc3de1-f84c-4621-904b-0ac894f835a9 for instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df on hv-cinder-85427 Aug 24 11:28:00.039633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-acd5590b-df8b-4c30-8e43-4bb599bd3598 req-e3762c35-7b5e-4306-a653-364e04719914 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Aug 24 11:28:00.040516 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 123/265] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:00.137714 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-39ab5d91-4b03-445f-bd6b-fe7e4feb2cb0 req-442718ea-acbe-4d03-9850-e46a98ca98c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "040f5a2c-3c12-4b35-bdc5-91a6d497c066", "tag": "1e711a0a-b7e0-44d7-90b0-2f700cc174b8"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:00.152080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-39ab5d91-4b03-445f-bd6b-fe7e4feb2cb0 req-442718ea-acbe-4d03-9850-e46a98ca98c6 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.153286 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-39ab5d91-4b03-445f-bd6b-fe7e4feb2cb0 req-442718ea-acbe-4d03-9850-e46a98ca98c6 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.154190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-39ab5d91-4b03-445f-bd6b-fe7e4feb2cb0 req-442718ea-acbe-4d03-9850-e46a98ca98c6 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.156577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:00.167992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-39ab5d91-4b03-445f-bd6b-fe7e4feb2cb0 req-442718ea-acbe-4d03-9850-e46a98ca98c6 service nova] Creating event network-changed:1e711a0a-b7e0-44d7-90b0-2f700cc174b8 for instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 on hv-cinder-85427 Aug 24 11:28:00.170409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-55ac23a6-0e52-4045-9540-04a2cbd77f11 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.397427 Aug 24 11:28:00.171332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 143/266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:59 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:00.217523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-39ab5d91-4b03-445f-bd6b-fe7e4feb2cb0 req-442718ea-acbe-4d03-9850-e46a98ca98c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083455 Aug 24 11:28:00.218193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 124/267] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:00.274374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:00.274834 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:00.283621 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.284849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.292257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.292257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.293816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.294147 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.572140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:00.584899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de032824-d703-4f7f-a59b-308bcec117dc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.315403 Aug 24 11:28:00.585861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 144/268] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:00 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:00.718176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:00.721362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:00.733193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.733788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.734921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.735800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.737329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.737827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.769066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lazy-loading 'flavor' on Instance uuid 91bc3b79-e078-405a-9d06-0a01d90b0dde {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:00.941549 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f2ff33c-b8cd-4e0e-8311-9356569ad1df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/action" status: 200 len: 32 microversion: 2.1 time: 0.228123 Aug 24 11:28:00.942617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 125/269] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:28:00 2022] POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:28:00.960175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:00.961505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:00.972849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.974909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.976202 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.977365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.982111 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.982428 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.196166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:01.198508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:01.207483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.207905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:01.208399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.209062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.210225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.211339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.212118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.221063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19af1232-9813-407f-8eb1-086d69838271 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.270395 Aug 24 11:28:01.222162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 145/270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:00 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:01.394900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:01.409328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6cb4b944-6d58-46da-a0ab-484be115b967 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.219228 Aug 24 11:28:01.410380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 126/271] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:01 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:01.618891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:01.619602 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:01.626431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.626989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.627420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.628381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.629253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.629724 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.787916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:01.798221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2cba1f97-13b1-44bc-b15e-ea52b6ac8b6b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.183872 Aug 24 11:28:01.798800 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 146/272] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:01 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:02.244541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:02.245256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:02.252178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.252649 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.253132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.253883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.254342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.254802 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.282119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:02.432793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:02.433615 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:02.435961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:02.442284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.443080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.443703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.444739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.445474 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.446133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.446269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20877524-5ee2-4a8a-a590-a3868b59d4d9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.206383 Aug 24 11:28:02.461378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 127/273] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:02 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:02.603489 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:02.611835 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e1321af-6c0d-473c-b26e-f03d1e48a3ac tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.182827 Aug 24 11:28:02.612469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 147/274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:02 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:02.820893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:02.821589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:02.827982 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.828551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.829011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.829829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.830288 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.830706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.979485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:02.988052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1124865f-477c-4558-803e-d81260bf32e4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.171467 Aug 24 11:28:02.988673 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 128/275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:02 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:03.469909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:03.470461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:03.477833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.478361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.478833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.479572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.480066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.480550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.632922 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:03.634588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:03.635310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:03.641670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74b5ce97-f4cc-4455-b5c0-8a9fe119dcac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.175826 Aug 24 11:28:03.642302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 148/276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:03 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:03.642621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.643065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.643582 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.644590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.645240 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.645667 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.805382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:03.813134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0b5b04ba-fac5-4fd2-b555-8457416d1187 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.183730 Aug 24 11:28:03.813731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 129/277] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:03 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:04.011629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:04.012351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:04.019239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.019725 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.020159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.021802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.022021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.022298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.219069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:04.229745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd0c718b-98b7-47d0-a7af-250913f978f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.222251 Aug 24 11:28:04.230467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 149/278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:04 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:04.665797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:04.666463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:04.668479 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:04.669164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=12 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:04.678455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.679243 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.679981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.681077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.682038 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.682902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.835197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:04.835955 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:04.837979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:04.845573 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.846074 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.846511 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.847022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:04.847215 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.847846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.848279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.856580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe90dc14-9ce5-4bae-96cd-9ad25f7b9293 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.195559 Aug 24 11:28:04.864085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 130/279] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:04 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:04.871468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:05.004031 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:05.016496 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92c1b39e-b27a-4b99-b8ff-219beba981c7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.185455 Aug 24 11:28:05.017441 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 150/280] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:04 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:05.254604 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:05.255990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:05.263164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.263317 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.263731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.264444 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.264912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.265557 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.445822 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:05.453992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bfa4f619-68c0-475b-a178-73cd43f054a5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.204944 Aug 24 11:28:05.454593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 131/281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:05 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:05.723704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:05.724732 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:05.731155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.731640 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.732069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.732766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.733228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.733643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.758292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c38751a0-0c7d-412f-9e61-7280e8e5dc42 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/ips" status: 200 len: 148 microversion: 2.1 time: 0.038574 Aug 24 11:28:05.758866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 151/282] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:28:05 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:05.879163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:05.880634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:05.889786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.890311 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.890790 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.891664 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.892152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.892577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.052068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:06.053517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:06.064487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.065268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.066062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.066938 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.068132 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.068839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.256637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:06.278820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcb3d876-281f-4105-bfdd-64cad4176796 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1314 microversion: 2.1 time: 0.231378 Aug 24 11:28:06.280944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 152/283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:06 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:06.388956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:06.415259 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-32bb7c4c-e46e-4b16-a654-a32903850428 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.540042 Aug 24 11:28:06.416353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 132/284] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:05 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:06.477062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:06.477952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:06.486754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.487521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.488112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.489365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.490145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.490819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.657634 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:06.668488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69584a73-791e-4965-aa12-246febd38ca9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.196235 Aug 24 11:28:06.669178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 153/285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:06 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:07.325847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:07.327808 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:07.328240 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5122c47-384e-4364-931a-d74e0bc4ace7"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:07.330933 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:07.337979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.338469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.338907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.339630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.340069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.340486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.346013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.346818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.347688 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.350342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.351184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.352711 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.526552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:07.535590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f6dc8720-4676-4088-9912-01b162c7bc14 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1499 microversion: 2.1 time: 0.231083 Aug 24 11:28:07.536420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 133/286] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:07 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1499 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:07.540778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:07.541418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:07.547525 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.547947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.548385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.549074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.549556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.550014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.703863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:07.713377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e7f3dae6-1255-44c0-918b-b10a97d58ab9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.176128 Aug 24 11:28:07.713965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 134/287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:07 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:07.718820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:07.719451 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:07.728144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.728681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.728681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.729884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.730334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.730791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.882819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:07.891217 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb131e81-80f2-46a4-815d-c1beea459674 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.176131 Aug 24 11:28:07.891775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 135/288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:07 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:08.735782 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:08.736492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:08.744035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:08.744573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:08.745019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:08.745795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:08.746264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:08.746697 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:08.928011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:08.942359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e42dc2b8-ad68-43ff-9b74-9d3e451c15c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.210399 Aug 24 11:28:08.943959 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 136/289] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:08 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:08.952136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:08.952760 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:08.960589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:08.961093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:08.961567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:08.962512 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:08.963208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:08.963913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:09.159434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:09.169568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6388d0ed-918c-4622-a9ba-26f1017c7502 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.224074 Aug 24 11:28:09.170190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 137/290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:08 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:09.970623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:09.971658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:09.988110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:09.989059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:09.990363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:09.991411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:09.991886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:09.992316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.147413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:10.155443 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c178ab6-d1f5-4d4d-8e7e-321bb7fb0e70 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.192174 Aug 24 11:28:10.156031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 138/291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:09 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:10.196263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:10.197152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:10.204729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.205301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.205744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.206578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.207037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.207465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.371603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:10.385497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5aac4bfa-7536-4650-8f98-a6bb9c82948a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.194342 Aug 24 11:28:10.389350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 139/292] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:10 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:10.619522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da7268f0-0352-46f4-a5e8-1bab13d6da54 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.294969 Aug 24 11:28:10.626960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 154/293] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:28:07 2022] POST /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments => generated 194 bytes in 3297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:10.915700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-f24a134f-842c-4674-8d69-35da19ee609d req-d175c4a7-e9ea-40cc-ae6a-3492516c5530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040f5a2c-3c12-4b35-bdc5-91a6d497c066", "name": "network-vif-plugged", "status": "completed", "tag": "1e711a0a-b7e0-44d7-90b0-2f700cc174b8"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:10.927948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f24a134f-842c-4674-8d69-35da19ee609d req-d175c4a7-e9ea-40cc-ae6a-3492516c5530 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.928404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f24a134f-842c-4674-8d69-35da19ee609d req-d175c4a7-e9ea-40cc-ae6a-3492516c5530 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.929010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-f24a134f-842c-4674-8d69-35da19ee609d req-d175c4a7-e9ea-40cc-ae6a-3492516c5530 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.944958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-f24a134f-842c-4674-8d69-35da19ee609d req-d175c4a7-e9ea-40cc-ae6a-3492516c5530 service nova] Creating event network-vif-plugged:1e711a0a-b7e0-44d7-90b0-2f700cc174b8 for instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 on hv-cinder-85427 Aug 24 11:28:10.951577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-f24a134f-842c-4674-8d69-35da19ee609d req-d175c4a7-e9ea-40cc-ae6a-3492516c5530 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043295 Aug 24 11:28:10.952199 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 140/294] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:11.183749 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:11.185018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:11.197497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.198775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.199808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.201645 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.202995 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.204098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.401719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:11.402965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:11.412094 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.412680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.413123 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.413927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.414375 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.414792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.460053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:28:11.554119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:11.561822 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2bf9013d-97df-47b1-a593-9d8b754600dc tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "DELETE /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 204 len: 0 microversion: 2.1 time: 0.166730 Aug 24 11:28:11.562393 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 141/295] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:28:11 2022] DELETE /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:28:11.568077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:11.568946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:11.576154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.576639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.577092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.577822 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.578365 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.578781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.589631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:11.598184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80836def-db45-4888-a30a-8c2501ca0474 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.423421 Aug 24 11:28:11.599422 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 155/296] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:11 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:11.609271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:11.609986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:11.617715 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.618278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.618712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.619458 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.619890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.620680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.756184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:11.768366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-46d30318-c147-4f92-be2e-28640602a0f5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.204707 Aug 24 11:28:11.769327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 142/297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:11 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:11.789663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:11.790269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:11.798077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.798674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.799900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.800903 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.801497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.802439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.807097 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:11.807370 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:11.822376 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86d7d55f-4b5a-4088-9ef2-4cfe87981c2e tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.221338 Aug 24 11:28:11.823503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 156/298] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:11 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:11.834928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05d58663-e064-47cd-9b4a-784ff1e52547 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/ips" status: 200 len: 150 microversion: 2.20 time: 0.051593 Aug 24 11:28:11.836811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 143/299] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Aug 24 11:28:11 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:28:12.624165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:12.624761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:12.631345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.631825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.632506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.633227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.633680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.634098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.771296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:12.778976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be552022-44a5-4ce3-926c-9fb9728cb7c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.158671 Aug 24 11:28:12.779501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 157/300] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:12 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:12.793449 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:12.794228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:12.800766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.801277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.801826 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.804549 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.805005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.805455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.850708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:12.851515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:12.859518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.860289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.860967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.861770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.863902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.865383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.966309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:12.975723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-49640f01-b57f-48cb-a156-a2009770c61a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.186083 Aug 24 11:28:12.976297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 144/301] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:12 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:13.029490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:13.038847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb81fc20-dca0-428f-b826-54f692c08fc7 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.192869 Aug 24 11:28:13.039419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 158/302] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:12 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:13.803133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:13.804013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:13.810757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.811239 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.811667 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.812361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.812809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.813251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.960716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:13.968870 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-66c1c2b9-db37-461a-8e34-04f10aa775f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.171508 Aug 24 11:28:13.969472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 145/303] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:13 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:14.002240 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:14.003273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:14.011486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.011486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.011878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.012484 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.012958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.013432 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.066639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:14.068501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:14.074973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.075468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.075910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.076625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.077123 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.077579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.189647 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:14.202301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60b75f37-8451-4ada-8fa1-abf68c52f16e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.203918 Aug 24 11:28:14.203607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 159/304] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:13 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:14.250401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:14.261617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f39ac1d7-f841-43b4-bce3-2a77d5cc54e5 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.200837 Aug 24 11:28:14.262223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 146/305] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:14 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:14.996232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:14.996838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:15.002944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.003535 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.003845 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.004533 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.005184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.005646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.156529 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:15.166142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d05968d3-2c99-40be-9e40-54d0da0db67d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.174113 Aug 24 11:28:15.166729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 160/306] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:14 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:15.226617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:15.227269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:15.237017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.237531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.237960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.238650 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.239102 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.239614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.285648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:15.287104 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:15.293634 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.294083 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.294517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.295200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.295646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.296064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.419530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:15.430371 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ea24dfee-7b62-4ae6-921f-91775c708563 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.208098 Aug 24 11:28:15.431379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 147/307] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:15 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:15.484304 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:15.497663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5edde642-68d6-444b-afec-9f1c9a38454a tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.216774 Aug 24 11:28:15.498292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 161/308] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:15 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:16.188572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:16.189181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:16.197365 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.198319 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.199001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.199944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.200670 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.201361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.351651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:16.359726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d07bc317-2d68-42ae-8b56-9466951701c7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.175254 Aug 24 11:28:16.360285 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 148/309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:16 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:16.454336 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:16.455302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:16.463249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.463739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.464176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.464863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.465339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.465762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.528674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:16.529706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:16.538830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.539501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.539995 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.540758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.541308 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.541844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.671751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:16.687100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5f97979-639b-4cc7-bea6-9b7a89ae2e3e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.236849 Aug 24 11:28:16.696045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 162/310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:16 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:16.741817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:16.750048 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd6578f9-d4d9-4d3e-93f1-f5c47105a6cf tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.225728 Aug 24 11:28:16.750900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 149/311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:16 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:17.384459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:17.385106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.392559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.393119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.393593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.395625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.396115 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.396538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.569857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:17.577907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4781fb8-3d67-4aad-8ba6-435406724fa8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.200229 Aug 24 11:28:17.578756 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 163/312] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:17 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:17.590171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:17.591060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.599423 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.600019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.600537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.601288 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.601748 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.602175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.637131 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lazy-loading 'flavor' on Instance uuid 18aa3b17-222c-4330-a1fd-72ee1a96c82e {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:17.709389 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:17.710113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.717881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.718429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.718866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.720007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.720921 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.721392 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.869832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4be2098d-bf86-4f91-b254-d25faeb8f589 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/action" status: 202 len: 0 microversion: 2.20 time: 0.283465 Aug 24 11:28:17.870835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 150/313] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 11:28:17 2022] POST /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:28:17.881013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:17.882581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.893798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.894855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.896142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.897247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.897799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:17.897943 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.898568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.908224 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-013f1d0a-0146-4792-ac19-8c1c10a372fb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.202965 Aug 24 11:28:17.908963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 164/314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:17 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:17.915285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:17.916513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.925012 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.925945 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.926574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.928963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.930300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.930300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.081902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.090655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9440a698-8d2d-4b0d-875e-002db7e6e098 tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.217955 Aug 24 11:28:18.091482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 151/315] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:17 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:18.099044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.109927 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.111452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.112623 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dba14bec-f804-44cc-805d-5483e1b89369 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.202303 Aug 24 11:28:18.113214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 165/316] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:17 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:18.174282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c4f6d63-5ba4-4ed6-9132-d328ca99fc31", "device": "/dev/sdb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:18.177637 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:18.183893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.184385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.184822 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.185581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.186035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.186459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.608628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:18.610907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:18.616919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.617341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.617757 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.618648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.619278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.619707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.624516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:19.025530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.039154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ace27f7-52d8-4b46-ab29-9976397f9b87 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.441239 Aug 24 11:28:19.040069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 166/317] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:18 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:19.046082 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:19.046796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:19.057278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.058102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.058768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.059987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.060741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.061680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.242415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.254204 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b8446f0a-e010-43ac-9f43-380f0ed090a0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1363 microversion: 2.1 time: 0.212488 Aug 24 11:28:19.255687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 167/318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:19 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:19.260707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:19.261367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:19.268232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.268708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.269140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.269856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.270301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.271333 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.468743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.477123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a78eed7a-9870-4118-aa04-ffc023a9267b tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1505 microversion: 2.1 time: 0.220352 Aug 24 11:28:19.477721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 168/319] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:19 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:19.482454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:19.483056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:19.488941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.490534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.490751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.491397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.491847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.492267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.624547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.633145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.634686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.635832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3463998f-f267-410b-a4f5-8f87cd22e231 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.157126 Aug 24 11:28:19.636386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 169/320] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:19 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:20.066978 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.069353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.092182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.093040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.093839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.095088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.095905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.096660 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.133575 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfb31b7b-85ee-4b96-b548-8034e002a1d3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "POST /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.962724 Aug 24 11:28:20.141354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 152/321] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:28:18 2022] POST /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67/os-volume_attachments => generated 194 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:20.279994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.281088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.288078 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.288671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.289113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.289899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.290352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.290776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.374296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.388567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a959348b-0e37-47a5-b5e2-3a83a9e5f2cd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.328048 Aug 24 11:28:20.389707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 170/322] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:20.507311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.507991 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.517044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.517879 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.518493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.519784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.520244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.521407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.546878 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.564420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c973b88a-e031-4e81-bfc2-ca24a1e7a82d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1547 microversion: 2.1 time: 0.289855 Aug 24 11:28:20.577540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 153/323] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1547 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:20.600589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.601394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.613068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.613845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.614943 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.616360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.617341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.618168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.640453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.649835 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ad962ed-453f-440e-8328-5bbb4e51b31f tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1463 microversion: 2.1 time: 0.152887 Aug 24 11:28:20.650403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 171/324] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:20.662753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.663770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.671731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.672434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.673244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.674128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.674586 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.675018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.724718 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d8ae8b6e-0e6a-4003-becb-80c0ad089d10 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134004 Aug 24 11:28:20.725657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 154/325] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:20.730542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8bf91749-4fb3-4f34-a4aa-bcb7629ac424 req-5df6401a-0b37-468c-91e3-b6527368ef23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818646e9-28d8-47c8-9e7d-c4bcd2baf4df", "name": "network-vif-deleted", "tag": "3ecc3de1-f84c-4621-904b-0ac894f835a9"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:20.742065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bf91749-4fb3-4f34-a4aa-bcb7629ac424 req-5df6401a-0b37-468c-91e3-b6527368ef23 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.742640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bf91749-4fb3-4f34-a4aa-bcb7629ac424 req-5df6401a-0b37-468c-91e3-b6527368ef23 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.743280 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8bf91749-4fb3-4f34-a4aa-bcb7629ac424 req-5df6401a-0b37-468c-91e3-b6527368ef23 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.775533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8bf91749-4fb3-4f34-a4aa-bcb7629ac424 req-5df6401a-0b37-468c-91e3-b6527368ef23 service nova] Creating event network-vif-deleted:3ecc3de1-f84c-4621-904b-0ac894f835a9 for instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df on hv-cinder-85427 Aug 24 11:28:20.783739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8bf91749-4fb3-4f34-a4aa-bcb7629ac424 req-5df6401a-0b37-468c-91e3-b6527368ef23 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056663 Aug 24 11:28:20.784522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 155/326] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:20.980914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.990685 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.992299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.993561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1990ef21-da4a-4e4f-984d-4d0ee1f15a31 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.337854 Aug 24 11:28:20.994129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 172/327] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:21.428438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:21.429144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:21.436278 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.436816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.437342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.438188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.438715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.439141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.633327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:21.649529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6512bef-9a09-4bfb-8680-199faaab9e2f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.225852 Aug 24 11:28:21.650727 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 156/328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:21 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:21.683174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:21.684355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:21.696608 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.697679 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.698563 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.699873 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.700784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.701653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.765679 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.766819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.767499 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.768745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lazy-loading 'fault' on Instance uuid 818646e9-28d8-47c8-9e7d-c4bcd2baf4df {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:21.827256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061e7f9c27e34122959fed8e48de95a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30257baa3ace4435bda61ac02eaf78a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:21.835862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-deec431b-97ff-4733-bdc9-20e56737344c tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 200 len: 1304 microversion: 2.1 time: 0.159221 Aug 24 11:28:21.836442 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 173/329] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:21 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:22.034348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:22.034820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.043629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.044512 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.045178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.046213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.047467 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.048537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.266073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:22.270340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:22.277350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:22.288449 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:22.289624 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90b1dfe9-ee96-47c3-9a6e-d7966fae649a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.260547 Aug 24 11:28:22.301259 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 157/330] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:22 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:22.676308 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:22.678554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.689923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.691229 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.691882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.695174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.696431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.697094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.838661 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-5cd21522-a73d-4128-81eb-d90702cfebd2 req-734a15b3-1fb5-4175-b60a-9684abe824e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "040f5a2c-3c12-4b35-bdc5-91a6d497c066", "tag": "1e711a0a-b7e0-44d7-90b0-2f700cc174b8"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:22.870669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5cd21522-a73d-4128-81eb-d90702cfebd2 req-734a15b3-1fb5-4175-b60a-9684abe824e8 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.871561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5cd21522-a73d-4128-81eb-d90702cfebd2 req-734a15b3-1fb5-4175-b60a-9684abe824e8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.872388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-5cd21522-a73d-4128-81eb-d90702cfebd2 req-734a15b3-1fb5-4175-b60a-9684abe824e8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.900187 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-5cd21522-a73d-4128-81eb-d90702cfebd2 req-734a15b3-1fb5-4175-b60a-9684abe824e8 service nova] Creating event network-changed:1e711a0a-b7e0-44d7-90b0-2f700cc174b8 for instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 on hv-cinder-85427 Aug 24 11:28:22.910157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-5cd21522-a73d-4128-81eb-d90702cfebd2 req-734a15b3-1fb5-4175-b60a-9684abe824e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076784 Aug 24 11:28:22.912601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 158/331] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:22.924725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:22.926445 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] [instance: 818646e9-28d8-47c8-9e7d-c4bcd2baf4df] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.940170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.941025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.941953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.943843 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.944320 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.944925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.962779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] HTTP exception thrown: Instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df could not be found. Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Request method failure captured: Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df HTTP/1.1 Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgsUy9j9t3Gi1Gme8p92D8t7WS4i50osFntoKfXAj1lVpyRnMSVL7dQgbT6shiFNblc9btMHJadH41Ou1V8-LH0NAslsRx3XOiW_ytxNiscbWM-NyqgVgEvzn6tAI2URgs0hJs6rEn0vXMJsuZt4CR2PunR-HV8VGrqooSWR8EeNVXY Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 30257baa3ace4435bda61ac02eaf78a5 Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesActionsTest-234368323 Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:28:22.964755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30257baa3ace4435bda61ac02eaf78a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesActionsTest-234368323 Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 30257baa3ace4435bda61ac02eaf78a5 Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesActionsTest-234368323 Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesActionsTest-234368323-project Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 061e7f9c27e34122959fed8e48de95a3 Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesActionsTest-234368323-project Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df could not be found. Aug 24 11:28:22.966252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '818646e9-28d8-47c8-9e7d-c4bcd2baf4df'} Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df could not be found. Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:28:22.966956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df could not be found. Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df could not be found. Aug 24 11:28:22.968109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:22.970918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] Returning 404 to user: Instance 818646e9-28d8-47c8-9e7d-c4bcd2baf4df could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:28:22.972231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c4716e5-5ce6-4bbd-b0f8-59d7c187a3cb tempest-VolumesActionsTest-234368323 tempest-VolumesActionsTest-234368323-project] 10.222.0.17 "GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df" status: 404 len: 111 microversion: 2.1 time: 0.057550 Aug 24 11:28:22.973016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 159/332] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:22 2022] GET /compute/v2.1/servers/818646e9-28d8-47c8-9e7d-c4bcd2baf4df => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:28:22.991118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0fe0b03-9843-4093-949c-324111d41e4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: .version_select at 0x7f5ba482ed30>, body: {"keypair": {"name": "tempest-keypair-482729551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo7ncbg3XSwk3s9kNJCWllZNlXZtllsMWdryDLWQL9Egl62+PQ6aFwujBL06JhN/6x+yGDYe9n+t9ndT0vknD5Ktsujf1zdOQAnK4ZHHAZtks/wSPdz7x32Q09MArKXCA=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:23.013379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.014158 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-b0fe0b03-9843-4093-949c-324111d41e4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:28:23.019820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-b0fe0b03-9843-4093-949c-324111d41e4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:28:23.052886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0fe0b03-9843-4093-949c-324111d41e4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075331 Aug 24 11:28:23.053959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d51c0e78-14b0-4a48-bc21-5117807f2b2b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.385003 Aug 24 11:28:23.054591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 160/333] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:28:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:23.055399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 174/334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:22 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:23.326751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:23.327593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:23.358307 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.359264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.359952 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.365615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.366698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.367464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.664490 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.694819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.699576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.704535 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98f988c6-1bac-4c2d-9d7a-cfd69e978c64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.381297 Aug 24 11:28:23.706509 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 161/335] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:23 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:24.089910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:24.092214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:24.102620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.103116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.103550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.104265 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.104777 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.105307 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.293358 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.304689 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1924d1b-b230-42d8-8438-a58f2a9dec9a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.224276 Aug 24 11:28:24.305292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 175/336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:24 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:24.732401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:24.733068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:24.739727 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.740387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.740824 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.741567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.742023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.742436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.962981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.971698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.973224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.974405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61650f04-b90c-453c-acfc-ae6451594f62 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.245971 Aug 24 11:28:24.974957 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 162/337] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:24 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:25.127843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-779256736", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f827975f-fb9d-4fba-ac33-57f23df4fae0"}], "security_groups": [{"name": "tempest-securitygroup--169446185"}], "key_name": "tempest-keypair-482729551", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:25.233690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] validate_networks() for [('f827975f-fb9d-4fba-ac33-57f23df4fae0', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:28:25.325342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:25.326727 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:25.333352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:25.333866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:25.334489 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.335197 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:25.335669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:25.336095 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.465798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:25.473332 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c2be03c-98fd-46a9-864c-ca9b44dd84e2 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.151843 Aug 24 11:28:25.474583 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 163/338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:25 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:25.622787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:28:25.623219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:28:25.623698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:28:25.624106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:28:25.624952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:28:25.634514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:25.634997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:25.635433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.636151 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:25.636601 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:25.637023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.654297 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:28:25.658191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:28:25.670388 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:28:25.672682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:28:25.724988 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3dbfd12b-0c8d-4adc-b72e-62f0eea8043e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601281 Aug 24 11:28:25.725671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 176/339] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:28:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:28:25.736301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-074610bb-3d54-48b4-8670-5ddcb3383d18 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:25.736913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-074610bb-3d54-48b4-8670-5ddcb3383d18 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:25.800434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-074610bb-3d54-48b4-8670-5ddcb3383d18 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:25.807759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-074610bb-3d54-48b4-8670-5ddcb3383d18 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1240 microversion: 2.1 time: 0.075185 Aug 24 11:28:25.808454 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 164/340] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:25 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:25.998396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:25.999004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:26.000908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:26.010572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.011611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.012669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.013917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.014716 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.015457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.177082 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:26.185182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:26.186760 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:26.187876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2965ba4-520c-4698-98c7-efd95aa3e55b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.193745 Aug 24 11:28:26.188431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 177/341] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:25 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:26.495395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:26.495912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:26.502591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.503074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.503500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.504192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.505516 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.505920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.635378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:26.642924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98e69078-7b48-4bf9-991c-c374420d6bcb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.151645 Aug 24 11:28:26.643485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 165/342] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:26 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:26.827881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:26.828502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:26.835099 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.835579 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.836014 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.836699 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.837152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.837599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.897883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:26.905309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f59dc83d-d45d-4812-b6d4-613f935ca7ec tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1244 microversion: 2.1 time: 0.081217 Aug 24 11:28:26.905866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 178/343] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:26 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:27.212143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:27.212709 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:27.218993 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.219469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.219894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.220574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.221017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.221531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.360752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:27.369501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:27.370995 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:27.372140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81000aa4-94d8-4e53-a298-2fdaeef98b3a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.165561 Aug 24 11:28:27.372675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 166/344] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:27 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:27.664343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:27.664958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:27.671434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.671918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.672357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.673043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.673522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.673946 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.819721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:27.827547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a86bb59-af0f-4016-a6e8-4b30102f5579 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.167471 Aug 24 11:28:27.828098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 179/345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:27 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:27.927265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:27.927770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:27.933686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.934167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.934597 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.935278 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.935723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.936170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.999400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:28.007552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c42166f4-f6a8-4a85-8413-fe44ff9ef9fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1236 microversion: 2.1 time: 0.084555 Aug 24 11:28:28.008146 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 167/346] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:27 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:28.394650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:28.395912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:28.402706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:28.403409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:28.403845 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:28.404547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:28.405005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:28.405449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:28.543572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:28.551914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:28.553464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:28.554881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f64c87b-513e-4f5e-92b6-d3289961045f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.163892 Aug 24 11:28:28.555218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 180/347] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:28 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:28.851558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:28.852307 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:28.860744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:28.861330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:28.861795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:28.862545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:28.863012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:28.863447 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.021191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.031751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8125a7ac-0b4f-4cb8-8843-a0673bd97276 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.185043 Aug 24 11:28:29.032807 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 168/348] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:28 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:29.033888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:29.034958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:29.046077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.046956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.048845 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.050399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.052130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.053158 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.123367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.131466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca0217f6-4071-414e-be81-524a531aa20d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1292 microversion: 2.1 time: 0.104942 Aug 24 11:28:29.132286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 181/349] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:29 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:29.580005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:29.580696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:29.587583 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.588332 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.589039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.589987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.590442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.590868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.799010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.810872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.812767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.814222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b085094-928e-4f56-bb73-3525f57f264a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.239872 Aug 24 11:28:29.830012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 169/350] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:29 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:30.069977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:30.070546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:30.081735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.082219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.083747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.087792 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.088908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.090381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.154116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:30.154742 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:30.162262 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.163042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.163658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.164504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.165101 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.165722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.264302 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:30.273541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37403e0d-62f7-42d3-87ac-6a92dcdc0f4e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1298 microversion: 2.1 time: 0.125176 Aug 24 11:28:30.274119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 170/351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:30 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:30.418734 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:30.431566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ca8f9e8-164b-4e37-8d6b-a4438ebd6fca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.364362 Aug 24 11:28:30.432448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 182/352] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:30 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:30.850689 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:30.851674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:30.870694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.871525 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.872286 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.873393 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.874012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.874598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.086759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.097314 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.098887 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.100051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19c5e6bd-a280-4a3f-b01e-fdaf79a27664 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.256655 Aug 24 11:28:31.100606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 171/353] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:30 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:31.299754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:31.300939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:31.315578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.317349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.318395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.319601 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.320381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.321149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.330486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:31.458424 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:31.460799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:31.471602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.472679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.474110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.475221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.475909 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.476558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.501287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.515088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80e4d793-bee5-4692-baff-5d93ec761a77 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.223147 Aug 24 11:28:31.516570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 183/354] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:31 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:31.638373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.649661 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-260d96c7-6eca-412e-9f74-13b4a5580bd4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.199255 Aug 24 11:28:31.651107 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 172/355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:31 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:32.129486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:32.131818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:32.140022 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.140737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.141247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.142356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.142928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.143353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.314784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.323983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.325604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.327004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c135d83-3e76-4666-80a8-ceb146bdf919 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.202961 Aug 24 11:28:32.327562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 184/356] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:32 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:32.539171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:32.539778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:32.546739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.547578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.548204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.549089 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.549701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.550275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.675071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:32.675964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:32.684070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.684555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.684992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.685714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.688286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.688942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.717901 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.727847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1930cfb8-87c1-4984-a85b-24cead63b667 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.192468 Aug 24 11:28:32.728831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 173/357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:32 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:32.856977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.865814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac380657-3b42-49cf-adf7-fe01b2bc6292 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.194608 Aug 24 11:28:32.866472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 185/358] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:32 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:33.351348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:33.351962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:33.360195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.360948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.361850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.363060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.364872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.365435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.547854 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:33.558519 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:33.560581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:33.562052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-965bd7c6-1417-4fe5-ad00-ad1d4884c8b1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.215196 Aug 24 11:28:33.577643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 174/359] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:33 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:33.749185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:33.750089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:33.759102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.759584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.760369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.761135 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.761743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.762331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.898227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:33.898853 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:33.922468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.922971 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.923412 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.930482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.931283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.937410 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.981680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:33.996247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-892c63db-9bf9-48cf-ac52-2e0e0d589e79 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.250851 Aug 24 11:28:33.998192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 186/360] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:33 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:34.251384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:34.262243 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07bbf3d9-b375-42cb-b3ac-1294a7652919 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.376199 Aug 24 11:28:34.276593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 175/361] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:33 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:34.588052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:34.588998 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:34.595763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:34.596700 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:34.597147 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:34.597952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:34.598573 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:34.599917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:34.890467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:34.899364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:34.900831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:34.903337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-38d80c32-48b4-4512-8442-d70eecbddb04 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.318079 Aug 24 11:28:34.917644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 187/362] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:34 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:35.030044 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:35.038285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a51735f7-4e9e-4091-bbb5-5560b83b5e16 req-cf712c2a-743d-4c84-ae9c-6d300a8caf3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5bdc96-1c5a-48e7-99b6-27d354088d77", "tag": "324279cd-577c-46a1-ad43-0796d09e58ba"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:35.041808 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:35.055529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.057966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a51735f7-4e9e-4091-bbb5-5560b83b5e16 req-cf712c2a-743d-4c84-ae9c-6d300a8caf3f service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.058806 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.059416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.060053 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a51735f7-4e9e-4091-bbb5-5560b83b5e16 req-cf712c2a-743d-4c84-ae9c-6d300a8caf3f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.060935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.061665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a51735f7-4e9e-4091-bbb5-5560b83b5e16 req-cf712c2a-743d-4c84-ae9c-6d300a8caf3f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.062947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.064346 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.093436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a51735f7-4e9e-4091-bbb5-5560b83b5e16 req-cf712c2a-743d-4c84-ae9c-6d300a8caf3f service nova] Creating event network-changed:324279cd-577c-46a1-ad43-0796d09e58ba for instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 on hv-cinder-85427 Aug 24 11:28:35.105748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a51735f7-4e9e-4091-bbb5-5560b83b5e16 req-cf712c2a-743d-4c84-ae9c-6d300a8caf3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071585 Aug 24 11:28:35.110472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 188/363] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:35.231861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:35.241386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad14a105-74f2-4ac8-9899-30e2b19a72ce tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.218886 Aug 24 11:28:35.242163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 176/364] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:35 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:35.292486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:35.293412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:35.300623 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.301559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.302066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.302788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.303237 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.303659 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.484776 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:35.499905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20c0df2b-1770-48a5-86cd-3915d2289fc6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.219606 Aug 24 11:28:35.500873 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 189/365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:35 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:35.924140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:35.925010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:35.930712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:35.938179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.938686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.939203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.939917 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.940536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.941036 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.086520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.090941 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:36.097755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.100651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.102121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cbd77b13-eedb-457a-89a3-5e0dc82e40ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.181952 Aug 24 11:28:36.117943 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 177/366] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:35 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:36.263960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:36.264557 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:36.266774 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:36.267612 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:36.273981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.274745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.275180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.275881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.276330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.276748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.427635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.435550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c7ff1b85-e759-434c-bce0-bbf0e52bed36 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.175526 Aug 24 11:28:36.436430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 190/367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:36 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:36.534560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:36.535777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:36.542603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.543098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.543546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.544261 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.544715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.545180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.709749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.721069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-212ca660-250f-4677-92cd-a8ab4dc93996 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.193396 Aug 24 11:28:36.728498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 178/368] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:36 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:37.132526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:37.133155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:37.139631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.140112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.140546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.141325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.141704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.142116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.358241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.368454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.370000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.371153 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6fcfcecd-ba53-4199-a4c6-0c12ac9a4db4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.247115 Aug 24 11:28:37.371710 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 191/369] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:37 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:37.464121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:37.466516 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:37.477143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.478145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.478939 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.479925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.480529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.481096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.655448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.666481 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d4ec731a-ad37-4495-ad74-e4f045e83c3c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.209840 Aug 24 11:28:37.667966 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 179/370] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:37 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:37.744719 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:37.745096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:37.753064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.753732 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.754291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.756387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.757946 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.759033 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.920642 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.932008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d682f5ea-d215-4a7d-9a92-5322e9458d5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.193319 Aug 24 11:28:37.933125 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 192/371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:37 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:38.402207 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:38.402941 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:38.415904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.416417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.416904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.417889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.418505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.421469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.610448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:38.619837 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:38.621787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:38.622974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9f2f0fc-2e1d-4bbe-b869-12871ac8bb4e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.224997 Aug 24 11:28:38.623532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 180/372] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:38 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:38.696140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:38.698004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:38.711475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.712243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.712674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.713471 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.714117 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.714914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.948504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:38.958606 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb69f93d-cdab-4493-a9b1-4bde85564392 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.270258 Aug 24 11:28:38.960068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:38.961806 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:38.974870 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.975933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.976805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.977970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.979498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.980475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.982178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 193/373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:38 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:39.148888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:39.162390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3c58c735-f1de-4cc4-af9f-b1e1e7e4d693 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.208786 Aug 24 11:28:39.168056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 181/374] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:38 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:39.648537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:39.649558 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:39.656079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.656642 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.657154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.658068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.658569 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.659096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.812393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:39.823342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:39.824846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:39.826043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-474673cb-f05b-40e3-bf3f-d30f630c3106 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.181976 Aug 24 11:28:39.826791 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 194/375] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:39 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:39.979958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:39.980731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:39.989897 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.990632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.991558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.992594 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.993411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.994108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:40.150673 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:40.159306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3fce2f41-3135-4174-adb8-5966c38dc68e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.183088 Aug 24 11:28:40.160932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 182/376] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:39 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:40.185835 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:40.186433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:40.193754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:40.195021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:40.195611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:40.197738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:40.198239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:40.198916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:40.355976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:40.368838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36bdbdd8-fa1d-40f3-9d3c-e85e60dfb340 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.186760 Aug 24 11:28:40.387130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 195/377] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:40 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:40.851041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:40.851764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:40.858498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:40.859072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:40.859605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:40.860452 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:40.860968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:40.861482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.003017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.015672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.017793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.019118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d4edf11-8bd3-409d-860b-b6a2dfadc188 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.172884 Aug 24 11:28:41.020902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 183/378] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:40 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:41.180273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:41.180894 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:41.188221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.188718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.189149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.189883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.190332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.190755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.360589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.371518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa55027b-0f26-4c18-a322-f792e38756cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.195279 Aug 24 11:28:41.372119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 196/379] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:41 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:41.394332 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:41.395757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:41.403622 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.404152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.406291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.406291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.406291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.406291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.564982 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.573430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5cffb1bf-3d3c-4789-b67e-53c815d6135a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.182927 Aug 24 11:28:41.574300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 184/380] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:41 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:42.043542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:42.044185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:42.050914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.053309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.053953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.054985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.055620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.056214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.221467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:42.234027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:42.236561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:42.239119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c28157ac-d7c6-4e04-a24f-d3d506b87edf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.198599 Aug 24 11:28:42.253749 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 197/381] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:42 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:42.402197 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:42.403058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:42.411271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:42.416503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.417163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.417831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.418898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.419731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.420383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.596300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:42.596898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:42.601463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:42.612415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.615955 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.616752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.618046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.619132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-18b52975-8c48-44f2-8e9b-517b2950d497 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.226622 Aug 24 11:28:42.619807 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.620640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 185/382] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:42 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:42.621453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.782660 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:42.793087 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-23742eb1-fe95-4ea9-8f0e-37fc92726934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.200783 Aug 24 11:28:42.793720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 198/383] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:42 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:43.265143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:43.265939 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:43.276436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.276942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.277413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.278126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.278613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.279069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.521425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.537404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.539009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.543293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd2afbe0-4ab8-4702-86f9-6b37c4f0dbc7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1743 microversion: 2.20 time: 0.281971 Aug 24 11:28:43.559351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 186/384] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:43 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1743 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:43.643430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:43.645447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:43.652720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.654114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.654721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.655595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.656040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.656455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.807252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.816634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:43.817434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:43.818065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-523703c0-2d7b-4dde-b54c-12557d19e579 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.178822 Aug 24 11:28:43.819042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 199/385] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:43 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:43.824715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.825236 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.825774 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.827870 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.829503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.830611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.986310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.995359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-427e874a-e799-4ba7-b004-1de813b8927c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1501 microversion: 2.1 time: 0.182513 Aug 24 11:28:43.996025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 187/386] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:43 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:44.017466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a08dd3-db67-46e3-9330-1fad5699b062"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:44.021660 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.029011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.029766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.030313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.031115 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.031787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.032288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.050682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:44.058934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] HTTP exception thrown: Cannot 'attach_volume' instance 91bc3b79-e078-405a-9d06-0a01d90b0dde while it is in vm_state rescued Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Request method failure captured: Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/os-volume_attachments HTTP/1.1 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 74 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrhz4gfHQU5F4BnbUrdMt4WvJrVKE326M2yKdG7ug6Zhfb5tlFsGbS8RBWl0IB6CA6GP6gejXKiplrbCPi7U-5iqCSIS09L1d3J_GrtWlp4FenA1OQmHXvTDAxoPAyKHcvefMTruSghEIXli1ol3_s2nbKmvMYHvn18His6ubYUa08 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:28:44.061717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 6f7224ed18ba423084846da68a920f52 Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "11a08dd3-db67-46e3-9330-1fad5699b062"}} Aug 24 11:28:44.063349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Cannot 'attach_volume' instance 91bc3b79-e078-405a-9d06-0a01d90b0dde while it is in vm_state rescued Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'server_id': '91bc3b79-e078-405a-9d06-0a01d90b0dde', 'body': {'volumeAttachment': {'volumeId': '11a08dd3-db67-46e3-9330-1fad5699b062'}}} Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:28:44.064359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 91bc3b79-e078-405a-9d06-0a01d90b0dde while it is in vm_state rescued Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:44.065856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:44.067888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:28:44.067888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:28:44.067888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 91bc3b79-e078-405a-9d06-0a01d90b0dde while it is in vm_state rescued Aug 24 11:28:44.067888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:28:44.069068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Returning 409 to user: Cannot 'attach_volume' instance 91bc3b79-e078-405a-9d06-0a01d90b0dde while it is in vm_state rescued {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:28:44.070269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-964ae4df-d909-4420-a310-90c5b5d52430 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057212 Aug 24 11:28:44.071351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 200/387] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:28:44 2022] POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:28:44.085791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:44.086657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.098282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.098282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.098282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.098282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.098998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.098998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.212427 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6653d1b7-a5f0-416c-9dab-bdc2df97e082 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/action" status: 202 len: 0 microversion: 2.1 time: 0.134211 Aug 24 11:28:44.213770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 188/388] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:28:44 2022] POST /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:28:44.223144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:44.223604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.233360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.233862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.234295 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.235245 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.235865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.236302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.558523 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:44.573005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:44.574372 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.580487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83ef5032-63ae-4535-a65f-37ba35ef45a8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1509 microversion: 2.1 time: 0.359724 Aug 24 11:28:44.581742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 201/389] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:44 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:44.593100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.595091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.596246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.597249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.597952 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.598574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.845607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:44.846681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:44.847187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.854280 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.854998 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.856274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.857492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:44.858861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.859453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:44.860381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.860794 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5be80288-5e6c-4ad1-b605-a3cb9ba6f8af tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1743 microversion: 2.20 time: 0.296297 Aug 24 11:28:44.861849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.862082 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 189/390] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:44 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1743 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:45.015275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:45.024402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d23461d6-4244-47e8-81e4-54b857202aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.186277 Aug 24 11:28:45.025084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 202/391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:44 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:45.606554 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:45.607172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:45.614014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.614494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.614929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:45.615634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.616086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.616508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:45.750691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:45.760161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ff71c64f-9c7c-4f35-9fc7-3363d0a8c560 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1509 microversion: 2.1 time: 0.157347 Aug 24 11:28:45.760746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 190/392] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:45 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:45.884847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:45.885601 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:45.892506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.893079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.893776 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:45.894635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.895100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.895576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.042635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.050489 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:46.051954 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:46.052096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.053489 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.054651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e58e450f-a05f-4e10-94c2-91ade94d3794 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1743 microversion: 2.20 time: 0.174069 Aug 24 11:28:46.055199 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 203/393] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:45 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:46.075914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.076407 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.076838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.077575 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.078024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.078442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.218004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.226300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8b5a6d55-18e4-4e43-8f74-b6b054427e7b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.183530 Aug 24 11:28:46.226878 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 191/394] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:46 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:46.781991 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:46.782591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:46.789699 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.790178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.790605 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.791283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.791725 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.792140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.912075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:46.912617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:46.919787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.920284 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.920718 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.921469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.921922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.922347 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.935721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.947319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-471c4c12-9324-45c7-b128-2639ee12aab1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1509 microversion: 2.1 time: 0.167786 Aug 24 11:28:46.948089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 204/395] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:46 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:47.064731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lazy-loading 'services' on Instance uuid ec67fbd5-125b-44eb-9a5c-170f31422b67 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:47.079642 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:47.080241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:47.089612 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.090121 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.090554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.091254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.091702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.092120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.183998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:47.198909 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6c83671a-286b-4472-97f6-ad777d04a41f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67/os-volume_attachments/7c4f6d63-5ba4-4ed6-9132-d328ca99fc31" status: 202 len: 0 microversion: 2.1 time: 0.291449 Aug 24 11:28:47.201246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 192/396] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:28:46 2022] DELETE /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67/os-volume_attachments/7c4f6d63-5ba4-4ed6-9132-d328ca99fc31 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:28:47.250626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:47.251479 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:47.255620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:47.261398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.261398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.261398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.261990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.262569 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.263078 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.279082 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:47.280884 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:47.281763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f511550f-1816-4d0f-b1cf-ef5c10c890d8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1743 microversion: 2.20 time: 0.205883 Aug 24 11:28:47.289925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 205/397] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:47 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1743 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:47.427246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:47.435157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34763629-6450-400a-a8be-81ebd246c577 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.190789 Aug 24 11:28:47.436006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 193/398] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:47 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:47.975970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:47.976867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:47.983267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.983756 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.984205 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.984896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.985405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.985832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.129951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.138870 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df6f7928-0de9-4e36-ba96-7ba1df3bee0e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1509 microversion: 2.1 time: 0.171070 Aug 24 11:28:48.139431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 206/399] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:47 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:48.187577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-89f863e9-0e75-4402-b8c9-efed58579856 req-b197afd4-d36e-424d-90c9-79d8babfcb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "name": "network-vif-plugged", "status": "completed", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:48.198970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89f863e9-0e75-4402-b8c9-efed58579856 req-b197afd4-d36e-424d-90c9-79d8babfcb94 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.199541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89f863e9-0e75-4402-b8c9-efed58579856 req-b197afd4-d36e-424d-90c9-79d8babfcb94 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.200054 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89f863e9-0e75-4402-b8c9-efed58579856 req-b197afd4-d36e-424d-90c9-79d8babfcb94 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.215224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-89f863e9-0e75-4402-b8c9-efed58579856 req-b197afd4-d36e-424d-90c9-79d8babfcb94 service nova] Creating event network-vif-plugged:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:28:48.220126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-89f863e9-0e75-4402-b8c9-efed58579856 req-b197afd4-d36e-424d-90c9-79d8babfcb94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036211 Aug 24 11:28:48.220999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 194/400] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:48.304066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:48.304712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:48.311273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.311866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.312497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.313389 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.313845 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.314270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.451075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.458888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:48.459609 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:48.460980 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.463138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.464420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7ea1c9e-8535-413c-8b01-6e62b0a4c16e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1743 microversion: 2.20 time: 0.164406 Aug 24 11:28:48.465036 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 207/401] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:48 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:48.466118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.466616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.467082 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.467787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:48.468241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:48.468663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.611710 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.627641 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f45cb245-4e92-4e70-bf23-e9bc5a2fcb94 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.173115 Aug 24 11:28:48.628744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 195/402] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:48 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:49.159803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:49.160512 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:49.171606 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.181064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.181814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.182750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.183196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.183625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.323498 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.331130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9d7cfc7-b6e8-4dcf-bb10-bcf70ac293c6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1515 microversion: 2.1 time: 0.175113 Aug 24 11:28:49.331700 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 208/403] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:49 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:49.489747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:49.490622 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:49.499722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.500493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.501012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.501992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.502868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.503625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.663675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.663867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:49.664442 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:49.673892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.674388 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.674814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.675685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.679556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.679792 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.681132 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.681316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-103c64dc-c5b2-476a-a411-ed889cd60393 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.197226 Aug 24 11:28:49.681975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.683476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 196/404] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:49 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:49.849067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.857256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f9cc757-cae0-46a7-b417-e6554424f3d4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.197795 Aug 24 11:28:49.857764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 209/405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:49 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:50.248695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-367ebed7-eb57-49d6-8232-cc1e789d8137 req-b549907f-ca04-4f64-9ece-56a8f99619bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5bdc96-1c5a-48e7-99b6-27d354088d77", "name": "network-vif-plugged", "status": "completed", "tag": "324279cd-577c-46a1-ad43-0796d09e58ba"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:50.266885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-367ebed7-eb57-49d6-8232-cc1e789d8137 req-b549907f-ca04-4f64-9ece-56a8f99619bf service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.267449 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-367ebed7-eb57-49d6-8232-cc1e789d8137 req-b549907f-ca04-4f64-9ece-56a8f99619bf service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.267885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-367ebed7-eb57-49d6-8232-cc1e789d8137 req-b549907f-ca04-4f64-9ece-56a8f99619bf service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.281463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-367ebed7-eb57-49d6-8232-cc1e789d8137 req-b549907f-ca04-4f64-9ece-56a8f99619bf service nova] Creating event network-vif-plugged:324279cd-577c-46a1-ad43-0796d09e58ba for instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 on hv-cinder-85427 Aug 24 11:28:50.287513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-367ebed7-eb57-49d6-8232-cc1e789d8137 req-b549907f-ca04-4f64-9ece-56a8f99619bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042458 Aug 24 11:28:50.288299 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 197/406] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:28:50.705819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:50.712401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:50.740054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.741720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.742782 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.744752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.745425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.746214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.810004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c0861ab6-1548-4390-b8f0-edb52a04290a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'create', calling method: .version_select at 0x7f5ba4a643a0>, body: {"keypair": {"name": "tempest-keypair-699073349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcl0DpTGGAff9jKwjVi1wqRCXAF6d+1A8Yqzm4WcWY8ZCNYNWuao3ZCI7BmFNZSBchzv1zCAlaGiN0HQ5nawVu724DcprK19KUsukSA2E4iFcVNCGcRE39FMAGkm6i++A=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:50.832209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-c0861ab6-1548-4390-b8f0-edb52a04290a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:28:50.838612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-c0861ab6-1548-4390-b8f0-edb52a04290a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for user 6f7224ed18ba423084846da68a920f52 and project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:28:50.872915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c0861ab6-1548-4390-b8f0-edb52a04290a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070263 Aug 24 11:28:50.874747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 198/407] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:28:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:50.882586 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:50.883640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:50.891166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.891836 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.892581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.893464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.894061 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.895336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.941034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:50.962664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:50.964944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:50.970146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a51f08be-0b03-40e5-8a6d-63917c45d81d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.264987 Aug 24 11:28:50.971206 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 210/408] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:50 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:51.132450 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:51.178651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f7b56822-57ac-4ab1-a11a-6bd683506944 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.302557 Aug 24 11:28:51.184206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 199/409] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:50 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:51.617090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:51.617705 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:51.629911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.632797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.633532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.634876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.638629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.639101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.673665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:28:51.900714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5578531-ca05-4458-8b2c-15931c8e4ac5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 204 len: 0 microversion: 2.1 time: 0.284972 Aug 24 11:28:51.903051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 211/410] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:28:51 2022] DELETE /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:28:51.914172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:51.914977 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:51.928189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.932571 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.934638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.935492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.937796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.939130 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.996797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:51.998118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:52.007642 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:52.008276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:52.008757 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.009526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:52.010177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:52.010628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.179099 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.192643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf4a9c22-8652-4dad-96c3-f3f6b22cfad1 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1513 microversion: 2.1 time: 0.283793 Aug 24 11:28:52.194185 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 200/411] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:51 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:52.211019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:52.214085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:52.229353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:52.230132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:52.230777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.231691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:52.232762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:52.234478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.338646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.353361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.355339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.356721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb09c62d-859e-4535-a638-8ee499d1958c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.365350 Aug 24 11:28:52.357469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 212/412] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:51 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:52.438296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.449382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-873974d9-88ec-4eb2-b4d6-3913094aba71 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.251835 Aug 24 11:28:52.450717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 201/413] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:52 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:53.041914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1441028649", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c70bafd0-5a35-4f61-9bc3-c5b84adfc134"}], "security_groups": [{"name": "tempest-securitygroup--2088446647"}], "key_name": "tempest-keypair-699073349", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:53.218648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:53.220132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:53.230396 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.231064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.231596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.232404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.232977 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.233533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.430626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:53.450994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4347050d-3fcb-4166-85b2-af3bc6e4becf tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1513 microversion: 2.1 time: 0.236216 Aug 24 11:28:53.451949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 202/414] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:53 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:53.457558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:53.458448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:53.465643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.466527 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.467126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.468124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.468844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.469476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.656128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:53.666273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:53.668013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:53.669601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2b96b6b-ecb2-4ca4-bb92-32600aa907dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.216472 Aug 24 11:28:53.676387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 203/415] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:53 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:53.682102 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:53.683038 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:53.690146 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.691001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.691983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.692865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.693564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.694204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.866960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:53.875472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ab8056c-bda5-45a5-814f-cfe98d9b269e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1365 microversion: 2.1 time: 0.197461 Aug 24 11:28:53.885750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 204/416] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:53 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:54.481594 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.482306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.493491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.494264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.494868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.495570 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.496166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.496734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.654168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.666305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b283c97e-f12a-4e15-9562-4af7ac60439c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1513 microversion: 2.1 time: 0.188628 Aug 24 11:28:54.667268 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 205/417] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:54 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:54.693337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.694934 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.701298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.701787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.702222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.702921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.703374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.703788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.873256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.883926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.885515 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.886715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de688b08-4806-4aff-a6aa-c1b0411a7401 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.198760 Aug 24 11:28:54.887281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 206/418] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:54 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:54.909536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.910852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.918088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.918793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.919388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.920255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.920883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.921487 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.183606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:55.194321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-71065d42-857c-4489-b51c-4f7756f22874 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1554 microversion: 2.1 time: 0.288535 Aug 24 11:28:55.213065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 207/419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:54 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:55.227091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:55.227091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:55.232834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.233330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.234368 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.235097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.235849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.236933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.389847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dfe95fc7-fc7b-427d-bc65-9beb0cb0a7ed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166016 Aug 24 11:28:55.389847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 208/420] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:28:55 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:55.688022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:55.688730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:55.700142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.703267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.705809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.707542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.710781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.711425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.858464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:55.873335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-61051026-e48b-4f14-967c-987f699993e3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 200 len: 1471 microversion: 2.1 time: 0.189088 Aug 24 11:28:55.874551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 209/421] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:55 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:55.879272 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-6c77cf36-a367-4e07-a1ba-cfc03d95b0f3 req-736a16c8-ef85-4eeb-b58a-0fbd40642f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec67fbd5-125b-44eb-9a5c-170f31422b67", "name": "network-vif-deleted", "tag": "9487eec8-02d0-4e5a-95f5-fd557fc4fc8f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:55.904530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6c77cf36-a367-4e07-a1ba-cfc03d95b0f3 req-736a16c8-ef85-4eeb-b58a-0fbd40642f6e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.913684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6c77cf36-a367-4e07-a1ba-cfc03d95b0f3 req-736a16c8-ef85-4eeb-b58a-0fbd40642f6e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.916402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-6c77cf36-a367-4e07-a1ba-cfc03d95b0f3 req-736a16c8-ef85-4eeb-b58a-0fbd40642f6e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.941589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-6c77cf36-a367-4e07-a1ba-cfc03d95b0f3 req-736a16c8-ef85-4eeb-b58a-0fbd40642f6e service nova] Creating event network-vif-deleted:9487eec8-02d0-4e5a-95f5-fd557fc4fc8f for instance ec67fbd5-125b-44eb-9a5c-170f31422b67 on hv-cinder-85427 Aug 24 11:28:55.949495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-6c77cf36-a367-4e07-a1ba-cfc03d95b0f3 req-736a16c8-ef85-4eeb-b58a-0fbd40642f6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073482 Aug 24 11:28:55.950410 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 210/422] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:55.957483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:55.958388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:55.965461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.966213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.966798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.967671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.968267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.968861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.172180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:56.196716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:56.198401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:56.201120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a945310-db5e-4c82-a421-dfe8f7b0874d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.247806 Aug 24 11:28:56.201945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 211/423] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:55 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:56.710909 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8c520272-35ab-410a-9cec-fe39d3aff74e req-99b7abdb-01d3-4524-b8ac-a6d4b9b65aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5bdc96-1c5a-48e7-99b6-27d354088d77", "tag": "324279cd-577c-46a1-ad43-0796d09e58ba"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:56.721952 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8c520272-35ab-410a-9cec-fe39d3aff74e req-99b7abdb-01d3-4524-b8ac-a6d4b9b65aa0 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.725047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8c520272-35ab-410a-9cec-fe39d3aff74e req-99b7abdb-01d3-4524-b8ac-a6d4b9b65aa0 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.725999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8c520272-35ab-410a-9cec-fe39d3aff74e req-99b7abdb-01d3-4524-b8ac-a6d4b9b65aa0 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.738675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8c520272-35ab-410a-9cec-fe39d3aff74e req-99b7abdb-01d3-4524-b8ac-a6d4b9b65aa0 service nova] Creating event network-changed:324279cd-577c-46a1-ad43-0796d09e58ba for instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 on hv-cinder-85427 Aug 24 11:28:56.755074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8c520272-35ab-410a-9cec-fe39d3aff74e req-99b7abdb-01d3-4524-b8ac-a6d4b9b65aa0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048460 Aug 24 11:28:56.756361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 212/424] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:56.904522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:56.906494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: ec67fbd5-125b-44eb-9a5c-170f31422b67] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.920508 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.922127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.923410 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.925487 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.926644 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.927807 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.993896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] HTTP exception thrown: Instance ec67fbd5-125b-44eb-9a5c-170f31422b67 could not be found. Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Request method failure captured: Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 HTTP/1.1 Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgsarmtCdJJUxNcTuVJPcz5fXUBJaqB0VKeHfIaIndlXk8ZzzN2mAphw3tZ66B28PAWwI_BQYmfPLlr0xPz5yo_0V_bOgp_UoyxZcxlb8KIzSdzbqYbPMgDWtGna5Wh0zJK6iD3gvSgi6IyuaI21RfHVCa48NiOHeQlOa4KRlWVQvAU Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: c968349e73bf45f48fdc00ba42989d8e Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1995391639 Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:28:56.997599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotTestJSON-1995391639 Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: c968349e73bf45f48fdc00ba42989d8e Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1995391639 Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotTestJSON-1995391639-project Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 9c69e150421e412384d055f51eb71868 Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotTestJSON-1995391639-project Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance ec67fbd5-125b-44eb-9a5c-170f31422b67 could not be found. Aug 24 11:28:57.000008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'ec67fbd5-125b-44eb-9a5c-170f31422b67'} Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec67fbd5-125b-44eb-9a5c-170f31422b67 could not be found. Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:28:57.001560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec67fbd5-125b-44eb-9a5c-170f31422b67 could not be found. Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec67fbd5-125b-44eb-9a5c-170f31422b67 could not be found. Aug 24 11:28:57.004418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:28:57.038360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Returning 404 to user: Instance ec67fbd5-125b-44eb-9a5c-170f31422b67 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:28:57.038360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ec5e4bd-e277-44fb-b0ea-0bc76f7b4c4d tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67" status: 404 len: 111 microversion: 2.1 time: 0.115523 Aug 24 11:28:57.038360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 213/425] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:56 2022] GET /compute/v2.1/servers/ec67fbd5-125b-44eb-9a5c-170f31422b67 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:28:57.227075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:57.227384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:57.242390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:57.243091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:57.243546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:57.248301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:57.248301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:57.248854 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:57.294192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:57.449895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:57.463770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:57.465379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:57.466570 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20d0ed17-3d3f-44f0-8af5-b656540e7b0d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.244272 Aug 24 11:28:57.467120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 214/426] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:57 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:28:58.494684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:58.495315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:58.514258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:58.514840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:58.515355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:58.516198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:58.516728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:58.519071 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:58.689456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:58.700620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:58.702493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:58.703798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da5d79f7-1f19-4143-b7f3-a81d266bfa0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.215617 Aug 24 11:28:58.704824 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 215/427] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:58 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:28:59.728685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:59.729374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:59.737330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:59.737833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:59.739017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:59.740028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:59.740494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:59.740921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:59.907228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:59.924383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:59.924383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:59.924383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8e320081-17df-4b88-b07a-3fcb33e0ed43 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.198267 Aug 24 11:28:59.931681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 216/428] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:28:59 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:00.948905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:00.949573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:00.951838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:00.958270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:00.959206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:00.959818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:00.960724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:00.961460 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:00.976765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:01.130610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:01.140910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:01.142577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:01.143863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f5dae699-6f1c-43ab-a91c-bcf0f2de183d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1738 microversion: 2.20 time: 0.201042 Aug 24 11:29:01.145430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 217/429] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:00 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:01.401997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] validate_networks() for [('c70bafd0-5a35-4f61-9bc3-c5b84adfc134', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:29:01.598253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:02.068949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:29:02.069637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:29:02.070206 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:29:02.070799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:29:02.071221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:29:02.080217 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.080699 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.081190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.081949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.082396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.082882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.103889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:02.107981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Getting quotas for user 6f7224ed18ba423084846da68a920f52 and project 8a049f6edc63419f8fc6895f3ee878f7. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:02.121388 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:29:02.123354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:29:02.171362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96213878-6b9a-4759-af00-d5ab086451e6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 9.133682 Aug 24 11:29:02.172129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 213/430] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:28:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 9135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:29:02.181379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:02.182065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:02.186337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be3d3d88-16c8-4067-97b7-5f7f811dd4f5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:02.187211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be3d3d88-16c8-4067-97b7-5f7f811dd4f5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:02.188620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.189181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.189968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.190702 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.191428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.191862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.260932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-be3d3d88-16c8-4067-97b7-5f7f811dd4f5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:02.268832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be3d3d88-16c8-4067-97b7-5f7f811dd4f5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1245 microversion: 2.1 time: 0.086218 Aug 24 11:29:02.269854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 214/431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:02 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:02.468096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:02.478698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:02.480255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:02.481627 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-478b4a80-184f-4370-9191-3ab96a2153eb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1720 microversion: 2.20 time: 0.304441 Aug 24 11:29:02.482408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 218/432] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:02 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:03.289255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:03.289865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:03.297271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.297753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.298196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.298880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.299330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.299749 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.364157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:03.371684 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fb7265a-bacc-4cda-ad8f-adcc65edaa68 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1249 microversion: 2.1 time: 0.086967 Aug 24 11:29:03.372242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 215/433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:03 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:03.505746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:03.506359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:03.513098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.513618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.514053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.514748 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.515202 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.515623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.659435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:03.668092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:03.669640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:03.670808 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aafed455-e44f-4e5a-aa15-6b13cddf1071 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1720 microversion: 2.20 time: 0.169657 Aug 24 11:29:03.671514 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 219/434] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:03 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:04.393650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:04.394477 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:04.403529 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:04.404008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:04.404435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:04.405255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:04.405851 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:04.406336 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:04.469778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:04.477904 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e163aa2-ae7a-49a7-97b8-c52b1406cd28 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1249 microversion: 2.1 time: 0.089563 Aug 24 11:29:04.478483 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 216/435] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:04 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:04.692487 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:04.693029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:04.699528 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:04.700015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:04.700451 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:04.701144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:04.701621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:04.702042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:04.839721 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:04.849612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:04.851146 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:04.852310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5fdf2fcb-62b5-46e9-84e5-42aec363f4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1720 microversion: 2.20 time: 0.163966 Aug 24 11:29:04.852866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 220/436] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:04 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:05.498503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:05.499235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:05.506920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:05.507383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:05.507818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:05.508504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:05.508953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:05.509399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:05.527880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:05.575232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:05.582786 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f90ea97-ca44-4841-aa3a-2b392f2cb386 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1249 microversion: 2.1 time: 0.088115 Aug 24 11:29:05.583345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 217/437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:05 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:05.875088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:05.875698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:05.882434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:05.883202 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:05.883634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:05.884321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:05.885057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:05.885507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:06.020271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:06.028437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:06.029910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:06.031057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-917659d2-1a8a-4e2e-b64d-2c676280a312 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1720 microversion: 2.20 time: 0.159935 Aug 24 11:29:06.031619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 221/438] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:05 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:06.248011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0ccfc0ae-e0af-4b4d-be62-7938a6383588 req-91826216-5aa7-4691-80ee-1038787cbb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "name": "network-vif-unplugged", "status": "completed", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:06.258886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0ccfc0ae-e0af-4b4d-be62-7938a6383588 req-91826216-5aa7-4691-80ee-1038787cbb95 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:06.259366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0ccfc0ae-e0af-4b4d-be62-7938a6383588 req-91826216-5aa7-4691-80ee-1038787cbb95 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:06.259788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0ccfc0ae-e0af-4b4d-be62-7938a6383588 req-91826216-5aa7-4691-80ee-1038787cbb95 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:06.278749 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0ccfc0ae-e0af-4b4d-be62-7938a6383588 req-91826216-5aa7-4691-80ee-1038787cbb95 service nova] Creating event network-vif-unplugged:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:29:06.283865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0ccfc0ae-e0af-4b4d-be62-7938a6383588 req-91826216-5aa7-4691-80ee-1038787cbb95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039523 Aug 24 11:29:06.284470 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 218/439] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:06.603711 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:06.604238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:06.610237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:06.610726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:06.611170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:06.611863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:06.612313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:06.612734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:06.678027 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:06.686215 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-255b8f20-b159-497e-b47d-dce4b3540e8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1297 microversion: 2.1 time: 0.086469 Aug 24 11:29:06.687237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 222/440] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:06 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:07.055736 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:07.056431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.062740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.063223 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.063655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.064345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.064797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.065236 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.194957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:07.203576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:07.205073 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:07.206248 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73c8d3f3-d3f4-45d0-9c9b-a1a243860a40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1723 microversion: 2.20 time: 0.155937 Aug 24 11:29:07.206797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 219/441] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:07 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:07.229917 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7918736-f029-4026-90be-a1978577e7c7"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:07.232091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.239641 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.240155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.240589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.241320 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.241765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.242184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.314395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1733897418", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "networks": [{"uuid": "42784ad8-e769-45bf-bea9-79cb53cd9cca"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:07.389090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] validate_networks() for [('42784ad8-e769-45bf-bea9-79cb53cd9cca', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:29:07.622742 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-272af084-e9df-4c6b-b864-3fad57d256f0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396905 Aug 24 11:29:07.623646 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 223/442] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Aug 24 11:29:07 2022] POST /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:29:07.713722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:07.713722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.721149 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.722345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.723541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.724376 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.724834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.725441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.813138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:29:07.813606 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:29:07.814075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:29:07.814478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:29:07.814881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:29:07.824547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.825018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.825475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.826186 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.826631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.827047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.844473 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Getting quotas for project c968349e73bf45f48fdc00ba42989d8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:07.849178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Getting quotas for user 9c69e150421e412384d055f51eb71868 and project c968349e73bf45f48fdc00ba42989d8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:07.849776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:07.858133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad3d5de0-4eb7-456b-b5b4-c51b6d9c4328 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1303 microversion: 2.1 time: 0.152957 Aug 24 11:29:07.858857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 224/443] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:07 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:07.861338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:29:07.864464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:29:07.880752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:07.881827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.888781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.889742 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.890935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.891779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.892345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.892872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.917880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35197e5f-2123-49da-81bb-b20567484d1c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606714 Aug 24 11:29:07.918820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 220/444] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:29:07.930480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86b6ff75-6ea4-47d5-b054-54f53ceaf128 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:07.931269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86b6ff75-6ea4-47d5-b054-54f53ceaf128 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.941695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:29:08.011803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-86b6ff75-6ea4-47d5-b054-54f53ceaf128 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:08.022098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86b6ff75-6ea4-47d5-b054-54f53ceaf128 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1219 microversion: 2.1 time: 0.096285 Aug 24 11:29:08.033246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 221/445] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:07 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:08.049016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4648b969-0f6e-4754-b01c-30e6c883b897 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/action" status: 202 len: 0 microversion: 2.20 time: 0.177716 Aug 24 11:29:08.049636 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 225/446] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 11:29:07 2022] POST /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:29:08.061560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:08.062113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:08.069125 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:08.069659 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:08.070075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:08.070775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:08.071392 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:08.071844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:08.235373 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:08.246883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:08.249172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:08.250875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f7d132c-9be9-49cb-8302-67bf7a55cb20 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1749 microversion: 2.20 time: 0.195759 Aug 24 11:29:08.251982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 222/447] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:08 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1749 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:08.883792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:08.884490 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:08.893325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:08.898145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:08.898962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:08.902765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:08.903844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:08.905513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.044683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:09.045651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:09.058570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.059174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.059615 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.060416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.060877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.061334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.162459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:09.171316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5e31673-6f4d-45a3-9d6c-a59c40f483a5 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1271 microversion: 2.1 time: 0.132261 Aug 24 11:29:09.171884 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 223/448] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:09 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:09.232724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:09.242314 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-01f9dd18-9046-487b-9620-953699ec6fa9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.363496 Aug 24 11:29:09.243297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 226/449] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:08 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:09.261030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a6ea4e92-4a36-4bea-934d-3c32dea0f4ae req-8cc9d2cd-b11c-45ad-a98c-516f5ac52023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c", "tag": "710de3ad-e4a8-487c-9709-7b5c8967061a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:09.272688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6ea4e92-4a36-4bea-934d-3c32dea0f4ae req-8cc9d2cd-b11c-45ad-a98c-516f5ac52023 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.273368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6ea4e92-4a36-4bea-934d-3c32dea0f4ae req-8cc9d2cd-b11c-45ad-a98c-516f5ac52023 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.273910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a6ea4e92-4a36-4bea-934d-3c32dea0f4ae req-8cc9d2cd-b11c-45ad-a98c-516f5ac52023 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.283609 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:09.284475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:09.286190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a6ea4e92-4a36-4bea-934d-3c32dea0f4ae req-8cc9d2cd-b11c-45ad-a98c-516f5ac52023 service nova] Creating event network-changed:710de3ad-e4a8-487c-9709-7b5c8967061a for instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c on hv-cinder-85427 Aug 24 11:29:09.289466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:09.291667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a6ea4e92-4a36-4bea-934d-3c32dea0f4ae req-8cc9d2cd-b11c-45ad-a98c-516f5ac52023 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037947 Aug 24 11:29:09.293032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 224/450] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:09.295854 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.296593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.297842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.298707 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.299321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.299953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.308583 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:09.462819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:09.478078 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:09.480840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:09.482938 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9b2f95e-19dc-4e1f-b96d-94c46af18cda tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1749 microversion: 2.20 time: 0.204945 Aug 24 11:29:09.483927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 227/451] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:09 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1749 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:10.194049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:10.195247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:10.212722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.217506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.218415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.219464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.220170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.220817 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.263814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:10.264415 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:10.278037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.278633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.279435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.280862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.281387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.282277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.448460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:10.460298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a741201-14aa-4d98-9743-7d41bf243036 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.270663 Aug 24 11:29:10.470401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 225/452] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:10 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:10.509450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:10.510513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:10.513611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:10.518241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.518735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.519463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.520333 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.521195 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.521787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.523409 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15e5be9d-0046-491a-a15e-2364d9e00307 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.263279 Aug 24 11:29:10.524178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 228/453] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:10 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:10.738916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:10.751547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:10.754480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:10.756113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36f61327-f4d1-4521-932a-dbe390443005 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1751 microversion: 2.20 time: 0.252571 Aug 24 11:29:10.760295 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 226/454] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:10 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:11.031817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-b95f8b42-8c22-4059-b6d6-7dd9ef1c4572 req-0fd969f5-b900-4871-8146-6c56a27816ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a640d3-715a-4751-92dd-87e7b18744fd", "tag": "48e70494-7a0c-493d-acc1-af46db8c7c5c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:11.042449 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b95f8b42-8c22-4059-b6d6-7dd9ef1c4572 req-0fd969f5-b900-4871-8146-6c56a27816ad service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.043012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b95f8b42-8c22-4059-b6d6-7dd9ef1c4572 req-0fd969f5-b900-4871-8146-6c56a27816ad service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.043450 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-b95f8b42-8c22-4059-b6d6-7dd9ef1c4572 req-0fd969f5-b900-4871-8146-6c56a27816ad service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.056416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-b95f8b42-8c22-4059-b6d6-7dd9ef1c4572 req-0fd969f5-b900-4871-8146-6c56a27816ad service nova] Creating event network-changed:48e70494-7a0c-493d-acc1-af46db8c7c5c for instance 23a640d3-715a-4751-92dd-87e7b18744fd on hv-cinder-85427 Aug 24 11:29:11.062200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-b95f8b42-8c22-4059-b6d6-7dd9ef1c4572 req-0fd969f5-b900-4871-8146-6c56a27816ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034208 Aug 24 11:29:11.062850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 229/455] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:11.484829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:11.486081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:11.494026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.494876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.495310 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.497984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.498077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.498424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.546061 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:11.547462 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:11.555108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.555943 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.556416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.557291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.557778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.558305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.638175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:11.646509 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad1e8881-7ffa-46b2-a5ae-828268cea388 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.165982 Aug 24 11:29:11.647085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 227/456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:11 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:11.699531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:11.708222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f0b9d46-9e2f-41ab-9b37-e355460c6d2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.166639 Aug 24 11:29:11.708771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 230/457] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:11 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:11.779859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:11.780456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:11.786475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.786953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.787381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.788056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.788499 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.788911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.916456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:11.924828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:11.926549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:11.927674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0357efeb-297d-4232-9275-d67d3291a4ea tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1751 microversion: 2.20 time: 0.151708 Aug 24 11:29:11.928221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 228/458] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:11 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:12.667231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:12.667844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:12.674567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:12.675046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:12.675480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:12.676237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:12.676869 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:12.677348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:12.729023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:12.729664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:12.736162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:12.736644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:12.737079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:12.737861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:12.738475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:12.739021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:12.887209 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:12.895778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71d30313-3e32-438c-8c1c-a063c0a78df1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.170647 Aug 24 11:29:12.896437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 229/459] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:12 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:12.951145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:12.951745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:12.958403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:12.958879 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:12.959304 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:12.959994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:12.960438 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:12.960854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:13.047354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:13.055989 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0d9b00e6-545d-407a-a28f-e19369689d23 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.392511 Aug 24 11:29:13.056562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 231/460] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:12 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:13.096677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:13.105886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:13.107079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:13.108233 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff6deb8d-3166-403e-914a-fb767dfa9442 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1751 microversion: 2.20 time: 0.161029 Aug 24 11:29:13.108791 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 230/461] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:12 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:13.916981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:13.917539 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:13.923956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:13.924486 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:13.924871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:13.925621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:13.926174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:13.926599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.058104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.065724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d1986cb-ecc9-4756-a227-59d4c632185f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.152618 Aug 24 11:29:14.066937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 232/462] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:13 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:14.076762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:14.077470 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:14.084857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.085366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.085800 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.086480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.086931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.087356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.132465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:14.133070 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:14.139083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.139557 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.139991 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.140686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.141133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.141580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.218983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.226997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e904a35d-4f73-4a46-9fd2-ae1dcd171f6c tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.153886 Aug 24 11:29:14.227597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 231/463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:14 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:14.281265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.292738 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.294433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.295624 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ad5e43b9-9ed2-4921-b7bf-8155e54d23a6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1751 microversion: 2.20 time: 0.167890 Aug 24 11:29:14.296198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 233/464] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:14 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:15.088580 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:15.090583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:15.097102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.103663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.104247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.107041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.107538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.108134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.248299 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:15.249784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:15.260461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.261364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.261999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.263641 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.264928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.265890 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.325453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:15.336363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c4747b3-ec36-4e77-a0ad-f403a13436e9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.252176 Aug 24 11:29:15.337294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 232/465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:15 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:15.343437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:15.344550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:15.363457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.364269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.364727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.365520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.366178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.367358 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.469856 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:15.484329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c01950d9-82f1-46b4-a8ab-dc23f6f7308f tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.239676 Aug 24 11:29:15.485605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 234/466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:15 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:15.518801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:15.528063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:15.529602 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:15.530757 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d27454e9-0d6e-4945-99d6-3d65c8acba7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.192115 Aug 24 11:29:15.531316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 233/467] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:15 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:16.359141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:16.360038 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:16.368110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.368889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.369354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.370207 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.370664 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.371083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.508936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:16.510191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:16.517142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.517403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.518189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.518893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.519811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.520448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.597139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.608638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-042a48cb-ba67-4173-8499-deefd81eb7ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.253621 Aug 24 11:29:16.620432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 235/468] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:16 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:16.622399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:16.623657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:16.632441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.633127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.633627 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.634405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.634858 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.635306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.689347 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.698524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7274bb93-a8ee-468e-8d92-5413a2187d63 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.195983 Aug 24 11:29:16.699086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 234/469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:16 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:16.779663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.788681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.790203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.791415 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0639de89-19d3-40f0-a63b-5f55252d3b90 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.175924 Aug 24 11:29:16.791956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 236/470] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:16 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:17.196222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-076b27a1-7317-4af3-aeeb-a1ecfe45d5b9 req-9b56c5a7-c774-4a85-a585-88115394eb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c", "name": "network-vif-plugged", "status": "completed", "tag": "710de3ad-e4a8-487c-9709-7b5c8967061a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:17.206641 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-076b27a1-7317-4af3-aeeb-a1ecfe45d5b9 req-9b56c5a7-c774-4a85-a585-88115394eb7a service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.207122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-076b27a1-7317-4af3-aeeb-a1ecfe45d5b9 req-9b56c5a7-c774-4a85-a585-88115394eb7a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.207548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-076b27a1-7317-4af3-aeeb-a1ecfe45d5b9 req-9b56c5a7-c774-4a85-a585-88115394eb7a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.220324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-076b27a1-7317-4af3-aeeb-a1ecfe45d5b9 req-9b56c5a7-c774-4a85-a585-88115394eb7a service nova] Creating event network-vif-plugged:710de3ad-e4a8-487c-9709-7b5c8967061a for instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c on hv-cinder-85427 Aug 24 11:29:17.226580 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-076b27a1-7317-4af3-aeeb-a1ecfe45d5b9 req-9b56c5a7-c774-4a85-a585-88115394eb7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034411 Aug 24 11:29:17.227099 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 235/471] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:17.632280 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:17.632860 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:17.639408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.639891 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.640319 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.641004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.641475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.641893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.719833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:17.720526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:17.729135 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.730052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.730639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.731363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.731800 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.732220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.773121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.780968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a1c66a7a-7ff9-4ed9-a09e-362dbd8616dc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.152931 Aug 24 11:29:17.781695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 237/472] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:17 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:17.815167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:17.815791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:17.822752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.823251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.823745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.824457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.824914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.825376 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.835536 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:17.883029 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.891639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bcbab9a1-fc25-4795-8805-1b963cb7f9bb tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.175929 Aug 24 11:29:17.892346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 236/473] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:17 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:17.978920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.988323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.990841 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.991997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-00a28b50-f16a-40f1-a6e7-2037696d4680 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.181023 Aug 24 11:29:17.992555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 238/474] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:17 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:18.806657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:18.807947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:18.811091 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:18.822769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.824628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.826009 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.827820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.829274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.830568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.918386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:18.919608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:18.927876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.928621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.929297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.930361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.930975 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.931558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.082490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.087431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:19.092448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb9e26bf-f144-4326-a611-49226c4b0f6c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.293359 Aug 24 11:29:19.100809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 237/475] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:18 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:19.112875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:19.113841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:19.138745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.139005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.139248 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.139690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.140406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.140861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.141317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.150076 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d95ff53b-9cc8-4c4e-acad-4bfc9f72f7a0 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.240023 Aug 24 11:29:19.168287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 239/476] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:18 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:19.373552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.385381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.387009 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.388417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5885a2e3-4c41-4123-9612-5c56b5c04dec tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.286204 Aug 24 11:29:19.389048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 238/477] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:19 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:20.121029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:20.121775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:20.128564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.129068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.129542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.130223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.130666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.131080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.180736 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:20.181529 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:20.193238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.193886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.194394 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.196030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.196030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.196234 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.308953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.316556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02976fe8-b7d2-40ef-817c-3cc8ef8cc570 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.199821 Aug 24 11:29:20.317120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 240/478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:20 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:20.374986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.383526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1329c45-f157-4146-a93e-517892c3ca28 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.207193 Aug 24 11:29:20.384109 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 239/479] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:20 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:20.421438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:20.422385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:20.430114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.430600 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.431203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.432220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.432681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.433100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.591565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.601681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.603208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.604399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-062ace30-bfe0-488b-ae4c-115885cf2d16 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.192010 Aug 24 11:29:20.604958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 241/480] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:20 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:21.337635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:21.338243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:21.344565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.345040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.345544 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.346419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.346893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.347311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.408362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:21.410024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:21.418192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.419042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.420598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.422034 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.422729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.423399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.539183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.559084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-adbfe868-c4b1-48df-928b-799c0e590eaf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.225477 Aug 24 11:29:21.569633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 240/481] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:21 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:21.616803 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.625492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-933404f9-2285-48c9-9fad-080468fa9966 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.220937 Aug 24 11:29:21.626460 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 242/482] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:21 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:21.627975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:21.628582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:21.635882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.636353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.636777 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.637500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.637944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.638361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.807359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.816275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.818593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.819973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d36d1395-901d-4251-ba1f-3f159b0e412a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.196284 Aug 24 11:29:21.820611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 241/483] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:21 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:22.582593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:22.583818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:22.591579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.592060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.592495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.593216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.593855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.594248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.647951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:22.649461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:22.666790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.667280 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.667717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.668417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.668870 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.669317 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.762359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:22.772027 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-17a614f7-5251-4cf6-88b7-06b620adda9d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.192843 Aug 24 11:29:22.785636 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 243/484] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:22 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:22.834249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:22.843227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c65f33b8-a1cf-4149-9a06-1fa689aa9bd2 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.200434 Aug 24 11:29:22.843458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:22.844333 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 242/485] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:22 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:22.845316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:22.855915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.856423 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.857262 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.857643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.858077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.858503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.890933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:23.046182 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:23.056426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:23.057956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:23.059124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d29cb9f8-1e8d-4cc3-9f90-faa0c618f385 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.220009 Aug 24 11:29:23.059872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 244/486] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:22 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:23.792593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:23.793278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:23.799666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.800146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.800580 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.801294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.802030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.802473 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.867428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:23.868025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:23.874688 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.875172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.875610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.876479 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.876935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.877386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.949893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:23.957610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70ab8c5d-24d6-4feb-8151-c0b592f0f4fc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.168785 Aug 24 11:29:23.969678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 243/487] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:23 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:24.051306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.067516 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-319598d9-c434-4974-94c4-03a041f78b75 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.205823 Aug 24 11:29:24.068403 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 245/488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:23 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:24.087050 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:24.087667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:24.093886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:24.094371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:24.094796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:24.095490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:24.106419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:24.106878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:24.268971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.281361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.282874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.284063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1f9ea4f-f566-4543-8b77-94a2ab45ae7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.201696 Aug 24 11:29:24.284626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 244/489] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:24 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:24.981037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:24.981803 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:24.988421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:24.989446 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:24.989908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:24.990719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:24.991177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:24.991605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.102244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:25.105029 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:25.124433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.125048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.125682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.126494 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.127016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.127693 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.219226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.229998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e572ab96-5d18-4125-a298-d2b34256c42c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.252821 Aug 24 11:29:25.241961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 246/490] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:24 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:25.329222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:25.330383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:25.340315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.341575 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.341749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.342448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.342914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.343433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.386268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.397799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-40fb6623-45af-4d85-ab0d-867422b09b25 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.303530 Aug 24 11:29:25.398991 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 245/491] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:25 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:25.567848 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.578043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.579762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.580932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d512bc5-dd31-43cc-b5c2-a3f388b91e13 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.260676 Aug 24 11:29:25.581534 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 247/492] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:25 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:26.001516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-07fae2bf-8e47-4d7a-87f2-f4ae6213b09d req-1859d0ef-175d-46aa-9fd8-5ddb691eab66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a640d3-715a-4751-92dd-87e7b18744fd", "name": "network-vif-plugged", "status": "completed", "tag": "48e70494-7a0c-493d-acc1-af46db8c7c5c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:26.022461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-07fae2bf-8e47-4d7a-87f2-f4ae6213b09d req-1859d0ef-175d-46aa-9fd8-5ddb691eab66 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.023150 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-07fae2bf-8e47-4d7a-87f2-f4ae6213b09d req-1859d0ef-175d-46aa-9fd8-5ddb691eab66 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.023899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-07fae2bf-8e47-4d7a-87f2-f4ae6213b09d req-1859d0ef-175d-46aa-9fd8-5ddb691eab66 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.041080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-07fae2bf-8e47-4d7a-87f2-f4ae6213b09d req-1859d0ef-175d-46aa-9fd8-5ddb691eab66 service nova] Creating event network-vif-plugged:48e70494-7a0c-493d-acc1-af46db8c7c5c for instance 23a640d3-715a-4751-92dd-87e7b18744fd on hv-cinder-85427 Aug 24 11:29:26.046768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-07fae2bf-8e47-4d7a-87f2-f4ae6213b09d req-1859d0ef-175d-46aa-9fd8-5ddb691eab66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050045 Aug 24 11:29:26.047373 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 246/493] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:26.272103 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:26.272864 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:26.279651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.280180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.280620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.281416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.282054 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.282383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.428232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:26.429086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:26.431159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:26.437924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.438412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.438677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.438883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.439530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.439977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.440399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.448752 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-687d8151-0586-4312-97d0-ec0efbc8d9b7 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.181661 Aug 24 11:29:26.449737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 248/494] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:26 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:26.592101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.602437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76e5066b-bd88-4e48-af52-10b82190bbe8 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.179278 Aug 24 11:29:26.602818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 247/495] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:26 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:26.619562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:26.620430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:26.630968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.631689 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.632129 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.632840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.633322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.633759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.829023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.839393 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.840873 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.842077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-47477c54-7b79-4d98-a9c6-7d6333daeb95 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.232236 Aug 24 11:29:26.842627 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 249/496] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:26 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:27.471335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:27.472261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:27.479074 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.479557 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.479986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.480721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.481179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.481624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.623629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:27.624431 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:27.626057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:27.632212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.633092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.633896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.634691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.635153 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.635270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c5d5994-c2d1-4fde-ade8-9554a7cd8e54 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.167467 Aug 24 11:29:27.635578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.635986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 248/497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:27 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:27.853614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:27.869068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7a06425f-f709-4166-a7e6-f7135d8a7a94 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.248619 Aug 24 11:29:27.875363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:27.878725 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:27.886262 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 250/498] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:27 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:27.897924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.900697 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.902037 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.903994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.905179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.906267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.085960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:28.099701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:28.102112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:28.103839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58159744-6695-4726-8574-de81e5e61a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.240215 Aug 24 11:29:28.104643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 249/499] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:27 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:28.657163 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:28.658452 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:28.670457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.670457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.670457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.670457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.672863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.672863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.817668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:28.827403 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-229ef92e-2082-41d7-b7a0-b4b0a9c6f1cf tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.174917 Aug 24 11:29:28.841234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 251/500] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:28 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:28.892230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:28.892871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:28.900714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.901123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.901580 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.902277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.902722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.903141 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.115899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:29.133728 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2175e6b-31a9-4ab9-acd6-4049e1111ad3 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.244745 Aug 24 11:29:29.135157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 250/501] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:28 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:29.139763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:29.140484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:29.149906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.150681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.151504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.152236 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.152696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.153120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.369886 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:29.387946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:29.391096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:29.392984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-85c6a72f-29a2-4860-af10-29f4c12d484c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.258395 Aug 24 11:29:29.394204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 252/502] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:29 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:29.851155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:29.851699 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:29.857964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.858450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.858885 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.859591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.860042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.860466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.001057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:30.009814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-433c9386-0d22-4d13-bccd-5bda71c99c5e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.163634 Aug 24 11:29:30.010404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 251/503] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:29 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:30.159558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:30.160120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:30.167620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.168107 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.168541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.169277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.169733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.170161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.331779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:30.342698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c95563a-208f-482e-b32f-0c8e467b8340 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.187033 Aug 24 11:29:30.343468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 253/504] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:30 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:30.432491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:30.433429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:30.439619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.440119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.440553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.441281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.442479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.443177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.625311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:30.640844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:30.642402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:30.644207 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b7f03ef-6139-46f1-a488-d3671f9ccdaa tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.217778 Aug 24 11:29:30.644781 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 252/505] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:30 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:31.030187 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.030821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.037852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.038245 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.038694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.039504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.040075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.040706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.067920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.068708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.076017 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.076500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.077325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.078172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.078766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.085383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.116492 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21862afd-b1aa-45fb-93fd-7996ebcb3d63 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/ips" status: 200 len: 144 microversion: 2.1 time: 0.052433 Aug 24 11:29:31.117604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 253/506] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/ips => generated 144 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:31.211987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.226394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-855f5998-fca7-416b-82b2-37e6d0c4f0dd tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.199564 Aug 24 11:29:31.240442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 254/507] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:31.367129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.367746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.373654 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.374138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.374726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.375919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.376378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.376810 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.521575 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.530085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47576bd3-0ba6-4f03-b347-d4b5f5f29313 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.167366 Aug 24 11:29:31.530664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 254/508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:31.667175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.667819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.674684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.675176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.675792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.676992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.677481 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.677910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.819066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.828177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.829758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.830920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02841d1e-82ec-4d26-adcc-1a518470e1da tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.167661 Aug 24 11:29:31.831482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 255/509] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:32.260497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.261860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.271472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.272321 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.273219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.274256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.274946 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.275607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.300871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:32.558837 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.561343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.576498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.588398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.589435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.590596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.591303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.591899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.684641 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:32.693345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2aa08de-bdce-47b9-897c-e76505107c5c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1371 microversion: 2.1 time: 0.437401 Aug 24 11:29:32.694182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 255/510] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:32.857182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.858482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.866984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.867766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.868433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.869589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.870680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.871539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.932612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:32.943135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fbb5210e-c5c3-4f36-b3b4-d5e526690b2e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.393564 Aug 24 11:29:32.944600 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 256/511] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:33.034266 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:33.043391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:33.044868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:33.046056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca5343bc-d257-45b2-878f-f28e6a45f9e5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.194307 Aug 24 11:29:33.046609 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 256/512] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:33.720295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.723894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.738524 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.742228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.742996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.743925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.744541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.745190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.977445 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.981851 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.996371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.996863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.997332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.998017 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.998461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.008849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.024513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.038569 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53c59090-3ad9-4cb2-9bfa-8fd51f3d8e15 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1566 microversion: 2.1 time: 0.325393 Aug 24 11:29:34.040724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 257/513] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:33 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1566 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:34.064363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:34.065289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:34.075046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.075872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.076726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.078940 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.080138 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.080758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.187759 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.196083 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a6c0898-0769-44f1-ba29-d14dcf4ee13e tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1319 microversion: 2.1 time: 0.226730 Aug 24 11:29:34.196656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 257/514] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:33 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:34.201420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:34.202252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:34.211212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.211698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.212185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.215244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.215244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.215244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.216567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e250d11-fd0a-4934-88c8-1378fbec78db tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159238 Aug 24 11:29:34.217900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 258/515] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:29:34 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:34.403000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.419908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.424476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.427898 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5427e32a-1160-4d7c-8eb4-fb0201c0ce33 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.228930 Aug 24 11:29:34.429010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 258/516] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:34 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:35.178273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "505d102a-1398-43a2-9e8e-0a5e46e8ea8d"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:35.180811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.188274 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.188765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.189225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.190116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.190923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.191024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.220045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:35.220655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.230217 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.230694 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.231058 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.231765 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.232405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.233161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.504350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.516795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e3f669e-cd03-4efd-86e1-8e6bfe3608f4 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1508 microversion: 2.1 time: 0.301482 Aug 24 11:29:35.533034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 259/517] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:35 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:35.533034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:35.533034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.540818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.541954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.542553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.543773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.544406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.544928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.731726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36e0fa02-f79e-4240-990c-4453c46b2b42 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549278 Aug 24 11:29:35.738491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 259/518] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:29:35 2022] POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:35.759009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9095331b-6488-4b87-bc1b-6fcb11e92337", "device": "/dev/sdb"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:35.762671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.776211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.777006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.777738 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.778847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.779746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.780516 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.810559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:35.877127 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.894412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.899515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.902654 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b60f2ec5-736c-4def-a603-74fbdbe1ee1b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.381317 Aug 24 11:29:35.905235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 260/519] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:35 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:36.148238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-149765b6-594a-4b90-a634-2b67307873cb req-9f58a25c-34e4-4697-85a4-dd5219ff98fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c", "tag": "710de3ad-e4a8-487c-9709-7b5c8967061a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:36.187812 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-149765b6-594a-4b90-a634-2b67307873cb req-9f58a25c-34e4-4697-85a4-dd5219ff98fb service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.192672 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-149765b6-594a-4b90-a634-2b67307873cb req-9f58a25c-34e4-4697-85a4-dd5219ff98fb service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.197700 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-149765b6-594a-4b90-a634-2b67307873cb req-9f58a25c-34e4-4697-85a4-dd5219ff98fb service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.236101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-149765b6-594a-4b90-a634-2b67307873cb req-9f58a25c-34e4-4697-85a4-dd5219ff98fb service nova] Creating event network-changed:710de3ad-e4a8-487c-9709-7b5c8967061a for instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c on hv-cinder-85427 Aug 24 11:29:36.248089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-149765b6-594a-4b90-a634-2b67307873cb req-9f58a25c-34e4-4697-85a4-dd5219ff98fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108339 Aug 24 11:29:36.249604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 261/520] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:36.349237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-137642d5-30cf-49d5-8792-0c3fdf13f4b9 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "POST /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.607493 Aug 24 11:29:36.349237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 260/521] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:29:35 2022] POST /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:36.941319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:36.943213 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:36.959024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.959527 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.959970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.960695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.961144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.961592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.338779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.352510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.354664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.357390 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c43261e-c972-490d-af01-7ec389a2c540 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.419876 Aug 24 11:29:37.369232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 262/522] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:36 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:38.384690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:38.385592 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:38.392894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.393726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.394165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.395613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.396068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.396679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.554197 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:38.564188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:38.565763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:38.568192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fc91d9b-ae65-423e-8c5d-8e17fd434125 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.190331 Aug 24 11:29:38.569011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 261/523] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:38 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:39.593679 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:39.594215 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:39.601473 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.602298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.602971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.603881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.604547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.605461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.792586 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.802444 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.804459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.805909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09c551e1-d131-4401-86ca-a3bf5ff8e4dd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.216238 Aug 24 11:29:39.821804 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 263/524] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:39 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:40.829823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.830599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:40.833568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=69 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:40.848913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.849995 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.857967 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.858769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.859249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.859706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.212837 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:41.230317 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:41.233654 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:41.235961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fa3ba5f-01af-4cf7-aee1-055e10b9655e tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.409511 Aug 24 11:29:41.237092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 262/525] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:42.263562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:42.265643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:42.273235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.274554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.275402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.276378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.277021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.277659 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.506468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:42.519542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:42.522250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:42.523555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f72f74f-1f30-4fe9-87a8-913baec05cb9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.266505 Aug 24 11:29:42.524542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 264/526] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:42 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:42.892405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-df56609a-854f-4583-b3f6-d9f7d36ea067 req-47efc928-d9bd-4098-9d5f-fc0bec2936ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "name": "network-vif-plugged", "status": "completed", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:42.906568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-df56609a-854f-4583-b3f6-d9f7d36ea067 req-47efc928-d9bd-4098-9d5f-fc0bec2936ba service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.911968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-df56609a-854f-4583-b3f6-d9f7d36ea067 req-47efc928-d9bd-4098-9d5f-fc0bec2936ba service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.912973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-df56609a-854f-4583-b3f6-d9f7d36ea067 req-47efc928-d9bd-4098-9d5f-fc0bec2936ba service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.929273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-df56609a-854f-4583-b3f6-d9f7d36ea067 req-47efc928-d9bd-4098-9d5f-fc0bec2936ba service nova] Creating event network-vif-plugged:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:29:42.936187 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-df56609a-854f-4583-b3f6-d9f7d36ea067 req-47efc928-d9bd-4098-9d5f-fc0bec2936ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047409 Aug 24 11:29:42.937714 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 263/527] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:43.534471 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9eb0cec-6864-4002-8abf-de8d3a6af633 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:43.549557 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:43.550230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:43.565496 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9eb0cec-6864-4002-8abf-de8d3a6af633 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.574064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9eb0cec-6864-4002-8abf-de8d3a6af633 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.574787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9eb0cec-6864-4002-8abf-de8d3a6af633 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.575528 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.580590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.581360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.582980 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.589963 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.592340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.756433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9eb0cec-6864-4002-8abf-de8d3a6af633 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:29:43.850171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9eb0cec-6864-4002-8abf-de8d3a6af633 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action" status: 202 len: 0 microversion: 2.1 time: 0.328652 Aug 24 11:29:43.854801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 265/528] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:43 2022] POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:43.862016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:43.862966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:43.879386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.882447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.883141 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.883911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.885111 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.885761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.949128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:43.980893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:43.983810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:43.984970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2b532cac-3b28-4b3b-b54f-b7c868949f08 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.440621 Aug 24 11:29:43.985569 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 264/529] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:43 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:44.138726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:44.151847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e424571-4a37-42b0-99e5-faba8cd77ebd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.294746 Aug 24 11:29:44.158502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 266/530] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:43 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:44.257433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da0a132b-080a-4450-88fb-6dd6a0d08ef3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Action: 'create', calling method: .version_select at 0x7f5ba46d2ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-564613301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH0BvUk4YQLrmL09s7qCp+lhPCcPno1i6yhq1yYo07hEekq3LIkD7nk4Gl0UvciCi5341+hMwxdl0SvyMQ4WMbWDdFqea+G1DJiN0PYa+Rvy5wOoSdjLBKO47jr365G5A=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:44.276657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-da0a132b-080a-4450-88fb-6dd6a0d08ef3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for project e54623c55367410db8070615915e573e. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:44.285005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-da0a132b-080a-4450-88fb-6dd6a0d08ef3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for user cbeabb83431b4536b4c5fdf71e8a5a80 and project e54623c55367410db8070615915e573e. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:44.315177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da0a132b-080a-4450-88fb-6dd6a0d08ef3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.328321 Aug 24 11:29:44.315931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 265/531] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:29:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:44.371770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:44.373137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:44.384980 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.385531 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.385977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.387476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.388048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.388699 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.434522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c44e1e86-132a-40ca-b993-252fbe0ee6cf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/ips" status: 200 len: 148 microversion: 2.1 time: 0.068718 Aug 24 11:29:44.436250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 267/532] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:29:44 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/ips => generated 148 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:44.450553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5122c47-384e-4364-931a-d74e0bc4ace7"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:44.453018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:44.463168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.464010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.464951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.466294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.467733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.468346 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.586028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Invalid volume: volume b5122c47-384e-4364-931a-d74e0bc4ace7 is already attached to instances: f2d189eb-9185-44a8-9935-0f111df1392a Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: POST /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/os-volume_attachments HTTP/1.1 Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 74 Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:29:44.589140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {"volumeAttachment": {"volumeId": "b5122c47-384e-4364-931a-d74e0bc4ace7"}} Aug 24 11:29:44.591085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Invalid volume: volume b5122c47-384e-4364-931a-d74e0bc4ace7 is already attached to instances: f2d189eb-9185-44a8-9935-0f111df1392a Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'server_id': '0d5bdc96-1c5a-48e7-99b6-27d354088d77', 'body': {'volumeAttachment': {'volumeId': 'b5122c47-384e-4364-931a-d74e0bc4ace7'}}} Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b5122c47-384e-4364-931a-d74e0bc4ace7 is already attached to instances: f2d189eb-9185-44a8-9935-0f111df1392a Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:44.591844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b5122c47-384e-4364-931a-d74e0bc4ace7 is already attached to instances: f2d189eb-9185-44a8-9935-0f111df1392a Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:44.593104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b5122c47-384e-4364-931a-d74e0bc4ace7 is already attached to instances: f2d189eb-9185-44a8-9935-0f111df1392a Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 400 to user: Invalid volume: volume b5122c47-384e-4364-931a-d74e0bc4ace7 is already attached to instances: f2d189eb-9185-44a8-9935-0f111df1392a {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:29:44.594330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d1e5a5c4-e026-4148-b5e2-f746e33471da tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146075 Aug 24 11:29:44.604220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:44.604677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:44.606937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 266/533] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:29:44 2022] POST /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:29:44.612424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.614069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.614632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.615417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.615935 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.616402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.651244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:29:44.769000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c0136bd-5694-4554-8f03-a913a996b528 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 204 len: 0 microversion: 2.1 time: 0.169354 Aug 24 11:29:44.770793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 268/534] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:29:44 2022] DELETE /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:29:44.780020 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:44.781696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:44.800265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.812970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.815771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.816633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.817105 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.817716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.019080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:45.020170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:45.028281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.029048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.029720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.030646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.031158 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.031765 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.041998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.054518 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-69241264-de27-4d39-b66e-c91d1d9a7db1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1678 microversion: 2.1 time: 0.278507 Aug 24 11:29:45.056612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 267/535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:44 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:45.180136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:45.181258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:45.189193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.190126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.191040 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.192478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.193233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.193884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.261155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.274187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.287258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.294916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1d10bf3-efe6-428f-a526-b8c054b3b7f1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.282965 Aug 24 11:29:45.296305 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 269/536] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:45 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:45.385900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.396646 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9fc5fb1c-ab56-4b54-b2e4-5b9302d3409c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.220906 Aug 24 11:29:45.397174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 268/537] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:45 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:46.077614 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:46.078923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:46.086774 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.087355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.087862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.088550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.089189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.089644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.110982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:46.275734 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.284218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-96763ede-5553-45a3-a3a8-2a68ea05aaf3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1678 microversion: 2.1 time: 0.210629 Aug 24 11:29:46.285000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 270/538] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:46 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:46.324325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:46.324948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:46.335581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.336111 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.336512 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.337244 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.337701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.338400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.417702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:46.418352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:46.431550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.433920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.434568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.436625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.437118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.437598 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.524438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.534254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.536830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.538475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ddf016ee-e6c3-42bc-bebe-a6a113be9d0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.218405 Aug 24 11:29:46.539205 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 269/539] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:46 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:46.608565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.618727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5485b4fb-6fc4-413e-b345-e18e6a0b88ea tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.204779 Aug 24 11:29:46.619306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 271/540] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:46 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:47.306410 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:47.307210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:47.313474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.313966 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.314403 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.315102 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.315553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.315972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.468366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.479771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8ef8057-12e1-4f2a-8ac8-c7ef90df2751 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1678 microversion: 2.1 time: 0.177048 Aug 24 11:29:47.480626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 270/541] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:47 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:47.566172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:47.567416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:47.574412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.575182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.575818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.576891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.577765 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.578196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.646210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:47.647165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:47.656374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.656774 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.657242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.657984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.658441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.658873 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.723502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.732321 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.733961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.735553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fdd31cf-567a-4876-b631-991f8d4bc824 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1807 microversion: 2.20 time: 0.173231 Aug 24 11:29:47.736112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 272/542] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:47 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:29:47.800369 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.808833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1898068-c9d0-4de8-9dde-f6b7c7a28302 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.167640 Aug 24 11:29:47.809432 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 271/543] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:47 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:48.503200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:48.503876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:48.511539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.512545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.513160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.514044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.514800 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.515372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.766157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:48.766885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:48.778997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.779755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.780213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.780923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.781417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.781855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.960158 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:48.975136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:48.977239 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:48.979675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8846c83c-0416-4ffa-82e3-f3e20ef7e99f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1794 microversion: 2.20 time: 0.221819 Aug 24 11:29:48.981064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 272/544] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:29:48 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1794 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:29:48.988151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:48.989951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:49.012906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.014376 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.015988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.017076 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.019216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.020852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.066143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:49.081651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14f825cf-9789-4822-a95b-26449954d8f1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1678 microversion: 2.1 time: 0.582275 Aug 24 11:29:49.100815 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 273/545] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:48 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1678 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:49.209512 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:49.225441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-81d83ce6-9ad2-439b-a329-186bcf131108 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.242537 Aug 24 11:29:49.226730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 273/546] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:48 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:49.753138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ec330314-a697-4578-a69c-152f65a6d393 req-a8d4a9b7-0005-4b17-92c0-4d347cce09ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5bdc96-1c5a-48e7-99b6-27d354088d77", "name": "network-vif-deleted", "tag": "324279cd-577c-46a1-ad43-0796d09e58ba"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:49.767211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec330314-a697-4578-a69c-152f65a6d393 req-a8d4a9b7-0005-4b17-92c0-4d347cce09ac service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.768190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec330314-a697-4578-a69c-152f65a6d393 req-a8d4a9b7-0005-4b17-92c0-4d347cce09ac service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.768838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec330314-a697-4578-a69c-152f65a6d393 req-a8d4a9b7-0005-4b17-92c0-4d347cce09ac service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.784796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ec330314-a697-4578-a69c-152f65a6d393 req-a8d4a9b7-0005-4b17-92c0-4d347cce09ac service nova] Creating event network-vif-deleted:324279cd-577c-46a1-ad43-0796d09e58ba for instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 on hv-cinder-85427 Aug 24 11:29:49.791701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ec330314-a697-4578-a69c-152f65a6d393 req-a8d4a9b7-0005-4b17-92c0-4d347cce09ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042639 Aug 24 11:29:49.796200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 274/547] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:50.122077 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:50.123093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:50.142639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.145502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.146610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.148151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.149287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.150662 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.213272 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.214013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.214591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.215179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 0d5bdc96-1c5a-48e7-99b6-27d354088d77 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:29:50.266027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:50.267320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:50.315924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.316555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.317068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.317865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.318577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.325962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.359174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:50.373840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cf1e3f8e-971b-4cab-8ef7-4995a53a4198 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1330 microversion: 2.1 time: 0.258077 Aug 24 11:29:50.380159 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 274/548] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:50 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1330 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:50.611264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:50.638596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdda8ed1-a576-4ea7-b67f-2dac0d939aa7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.377607 Aug 24 11:29:50.640318 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 275/549] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:50 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:51.402459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:51.404098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:51.423475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.423974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.424418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.425133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.425698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.426124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.466453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.467192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.468080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.469117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 0d5bdc96-1c5a-48e7-99b6-27d354088d77 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:29:51.526927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:51.539745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b49ee58-bb13-45b6-9595-503dedb66bb3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 200 len: 1330 microversion: 2.1 time: 0.142578 Aug 24 11:29:51.540728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 275/550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:51 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 1330 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:51.666144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:51.667912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:51.675211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.676292 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.676738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.677495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.677984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.678415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.869486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:51.882627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee8a690a-4b17-4517-a356-558a5ddf1d62 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.224183 Aug 24 11:29:51.886501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 276/551] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:51 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:52.569088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:52.569736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:52.576402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.576883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.577335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.578019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.578466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.578881 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.592990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 HTTP/1.1 Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:29:52.594469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:29:52.595981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '0d5bdc96-1c5a-48e7-99b6-27d354088d77'} Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:29:52.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:29:52.599173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:29:52.600576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:29:52.600576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-74fa2079-c7ab-4275-ac25-e20a467fd511 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 404 len: 111 microversion: 2.1 time: 0.030795 Aug 24 11:29:52.600576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 276/552] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:52 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:29:52.606196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a410f4f-c552-468c-81fa-a74f7c1f0770 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '.version_select at 0x7f5ba47ff160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:52.631802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a410f4f-c552-468c-81fa-a74f7c1f0770 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482729551" status: 202 len: 0 microversion: 2.1 time: 0.029701 Aug 24 11:29:52.632399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 277/553] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 11:29:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482729551 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:52.906834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:52.907451 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:52.914023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.914517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.914962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.915665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.916129 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.916555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.920827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:53.169326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:53.181235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-36cec3a9-3056-475e-b7bc-1fc11fa289c1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.278160 Aug 24 11:29:53.193527 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 277/554] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:52 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:53.425090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:53.426335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:53.433012 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.433524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.433959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.434735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.435274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.435702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.564433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'services' on Instance uuid f2d189eb-9185-44a8-9935-0f111df1392a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:29:53.678548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4a9ee69-0bee-4b0d-a403-2dd4e5e0efb6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments/b5122c47-384e-4364-931a-d74e0bc4ace7" status: 202 len: 0 microversion: 2.1 time: 0.257590 Aug 24 11:29:53.679114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 278/555] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:29:53 2022] DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments/b5122c47-384e-4364-931a-d74e0bc4ace7 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:53.689172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:53.692326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:53.699857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.700678 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.701298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.702018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.702491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.702920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.735150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-429cdd8e-b947-4333-aa96-b8cb7eb7fdd2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050028 Aug 24 11:29:53.735722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 278/556] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:53 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:54.204554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:54.205169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:54.212645 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.213126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.213584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.214274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.214725 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.215145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.360259 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:54.368514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd56d69f-5eec-4106-88da-1f4872a06cf2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.168453 Aug 24 11:29:54.369078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 279/557] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:54 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:54.748567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:54.750756 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:54.752818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:54.760075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.760598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.761140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.762079 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.762675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.763120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.798336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1bcf143-c9a4-4e2c-aa65-0ec1d35dafe1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053690 Aug 24 11:29:54.798899 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 279/558] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:54 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:55.391071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:55.391714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:55.398658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.399149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.399588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.400301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.400756 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.401183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.543565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:55.551971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d91ca31-9c67-40d9-b04d-7514e86416d2 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.164795 Aug 24 11:29:55.552550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 280/559] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:55 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:55.812660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:55.814724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:55.822069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.822550 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.822983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.823676 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.824117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.824532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.855310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f722492c-e6b8-4035-9858-e264c5a5b834 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Aug 24 11:29:55.855875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 280/560] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:55 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:56.573844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:56.574380 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:56.576769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:56.582040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.582522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.582954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.583638 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.584088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.584510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.725575 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:56.734551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65ea70e3-494b-4688-a6a9-3b703fae510b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.164561 Aug 24 11:29:56.735211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 281/561] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:56 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:56.867679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:56.869872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:56.876729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.877226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.877665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.878357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.878840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.879261 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.912198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ebfe71a-08f9-477c-a30d-50ede411de30 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048393 Aug 24 11:29:56.912786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 281/562] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:56 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:57.757177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:57.757811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:57.764263 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:57.764742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:57.765177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:57.765899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:57.766347 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:57.766767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:57.909651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:57.920460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb88e2ed-b273-4c9f-850c-f912457f2684 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.167517 Aug 24 11:29:57.921430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 282/563] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:57 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:57.927343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:57.929563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:57.936645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:57.936645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:57.936953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:57.937598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:57.938244 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:57.938719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:57.971268 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab183172-dd3c-407b-b1e6-5e5a07152507 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049257 Aug 24 11:29:57.972303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 282/564] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:57 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:29:58.039825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:58.040315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:58.046370 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.046854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.047293 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.047991 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.048446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.048875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.076438 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:29:58.171077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0383fe6-a280-4f9a-800b-f4587d433717 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 204 len: 0 microversion: 2.1 time: 0.134938 Aug 24 11:29:58.172054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 283/565] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:29:58 2022] DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:29:58.180741 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:58.181401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:58.188325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.188816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.189284 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.189986 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.190440 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.190861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.337900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:58.353009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c82db95d-b864-4068-85c4-3bf55204a429 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1678 microversion: 2.1 time: 0.176007 Aug 24 11:29:58.353652 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 283/566] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:58 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:58.943644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:58.944290 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:58.951369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.951853 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.952296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.952996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.953467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.953890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.101077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:59.109448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1419cdc5-639a-4795-97af-58baf3f5b40b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.170209 Aug 24 11:29:59.110051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 284/567] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:58 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:59.373969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:59.374581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:59.383551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.384047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.384485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.385185 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.385712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.386135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.524962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:59.534468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-106ecdba-33ba-4720-bc3e-98cac1927565 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1678 microversion: 2.1 time: 0.164066 Aug 24 11:29:59.535321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 284/568] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:59 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:00.131896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:00.132618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:00.139510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.139989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.140423 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.141119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.141604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.142024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.313671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:00.325021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa2b3d56-700a-4dcd-999d-5e401641c65a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.198230 Aug 24 11:30:00.325691 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 285/569] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:00 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:00.556394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:00.557007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:00.563819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.564358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.564831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.565682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.566813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.567238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.718101 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:00.726624 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-52ac492d-7ada-4e5f-bf73-aebe0ed96e20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1678 microversion: 2.1 time: 0.174133 Aug 24 11:30:00.727209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 285/570] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:00 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:01.350807 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:01.352021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:01.360746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.361285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.361718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.362584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.363035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.363451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.386581 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:01.513558 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:01.524045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6ee5a007-0506-41ab-9eb7-9b4c8d62ac8b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.179691 Aug 24 11:30:01.525000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 286/571] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:01 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:01.747922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:01.748522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:01.755271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.756006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.756437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.757133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.757611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.758031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.908250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:01.917019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e1324b3-16ab-4c62-b580-d6afd92f9d15 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1678 microversion: 2.1 time: 0.172928 Aug 24 11:30:01.917625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 286/572] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:01 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:02.550593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:02.551507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:02.557435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.557928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.558369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.559140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.559521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.559944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.721262 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:02.732273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-413ccbe2-ea3a-4b41-9d8f-562f5195b7c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.185803 Aug 24 11:30:02.732872 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 287/573] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:02 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:02.938578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:02.939414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:02.946165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.946766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.947275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.948045 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.948581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.949014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:03.111503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:03.127525 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80d23c35-1ca3-45da-87a8-60f3fa71b8c3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1678 microversion: 2.1 time: 0.192450 Aug 24 11:30:03.128729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 287/574] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:02 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:03.772007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:03.772758 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:03.781275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:03.781969 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:03.782647 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:03.783838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:03.784595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:03.785937 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.077353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:04.090020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-509169da-0e01-4f16-8a00-0f3037ee3a3c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.324841 Aug 24 11:30:04.091009 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 288/575] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:03 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:04.152199 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:04.152815 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:04.159428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.159974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.160590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.161337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.161992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.162426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.496157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:04.515760 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c69b0d68-0915-4e86-b085-a5604680d277 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1611 microversion: 2.1 time: 0.367726 Aug 24 11:30:04.516913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 288/576] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:04 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1611 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:04.567410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-42dc5cdd-a7bb-4cdb-b001-c566b628b4aa req-68241d6a-7472-4a7d-aa5a-1f1d6c1b6187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d189eb-9185-44a8-9935-0f111df1392a", "name": "network-vif-deleted", "tag": "565171f6-781f-4abf-be7d-35ef0a25f7ad"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:04.577786 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-42dc5cdd-a7bb-4cdb-b001-c566b628b4aa req-68241d6a-7472-4a7d-aa5a-1f1d6c1b6187 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.578271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-42dc5cdd-a7bb-4cdb-b001-c566b628b4aa req-68241d6a-7472-4a7d-aa5a-1f1d6c1b6187 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.578731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-42dc5cdd-a7bb-4cdb-b001-c566b628b4aa req-68241d6a-7472-4a7d-aa5a-1f1d6c1b6187 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.594965 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-42dc5cdd-a7bb-4cdb-b001-c566b628b4aa req-68241d6a-7472-4a7d-aa5a-1f1d6c1b6187 service nova] Creating event network-vif-deleted:565171f6-781f-4abf-be7d-35ef0a25f7ad for instance f2d189eb-9185-44a8-9935-0f111df1392a on hv-cinder-85427 Aug 24 11:30:04.605250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-42dc5cdd-a7bb-4cdb-b001-c566b628b4aa req-68241d6a-7472-4a7d-aa5a-1f1d6c1b6187 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040941 Aug 24 11:30:04.610658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 289/577] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:05.124406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:05.125028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.133379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.133889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.134327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.135258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.135728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.136156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.156694 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:05.157658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.165169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.166069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.166813 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.167993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.168785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.169420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.286200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lazy-loading 'services' on Instance uuid 23a640d3-715a-4751-92dd-87e7b18744fd {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:30:05.319976 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:05.330500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b588028d-9ecc-4f06-ae18-4bb6c0536fd9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.210768 Aug 24 11:30:05.332521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 289/578] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:05 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:05.406322 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49768c66-3b05-4be8-83aa-0ec1e2074b33 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "DELETE /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd/os-volume_attachments/9095331b-6488-4b87-bc1b-6fcb11e92337" status: 202 len: 0 microversion: 2.1 time: 0.254613 Aug 24 11:30:05.407712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 290/579] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:30:05 2022] DELETE /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd/os-volume_attachments/9095331b-6488-4b87-bc1b-6fcb11e92337 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:30:05.538506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:05.539572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.553322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.553696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.554096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.560476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.560476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.560476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.606870 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.607358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.607813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.608264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid f2d189eb-9185-44a8-9935-0f111df1392a {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:30:05.656179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:05.664296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d41dd50b-288d-40fa-adb7-dc2879f9be6b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 200 len: 1330 microversion: 2.1 time: 0.129890 Aug 24 11:30:05.664909 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 290/580] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:05 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:06.364628 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.365512 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:06.372334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.372912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.373421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.374151 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.374615 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.375094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.519595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:06.527740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5441bb98-ae59-4ab9-9cde-ec9beb567146 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1722 microversion: 2.1 time: 0.167502 Aug 24 11:30:06.528311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 291/581] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:06 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:06.690284 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.691684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:06.698538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.699026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.699447 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.700133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.700577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.700990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.715621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a HTTP/1.1 Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:30:06.717248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:30:06.719067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'f2d189eb-9185-44a8-9935-0f111df1392a'} Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:30:06.720221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:30:06.721382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:06.723209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:30:06.723209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-725793df-2998-41a1-9b6e-8405645cd45c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 404 len: 111 microversion: 2.1 time: 0.032733 Aug 24 11:30:06.723209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 291/582] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:06 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:30:06.728975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-236baf92-1c64-41df-8b78-6a5bc12bd3b4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '.version_select at 0x7f5ba47ff0d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.739851 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-681333398", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-564613301", "security_groups": [{"name": "tempest-secgroup-smoke-900977225"}], "block_device_mapping_v2": [{"uuid": "332805b6-f38d-4322-9a26-fa7fb2755652", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "76bed7fc-2ca1-4c54-8559-9ea4dba9aee6"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:06.754412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-236baf92-1c64-41df-8b78-6a5bc12bd3b4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245543157" status: 202 len: 0 microversion: 2.1 time: 0.028749 Aug 24 11:30:06.755281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 292/583] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 11:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245543157 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:30:06.926863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] validate_networks() for [('76bed7fc-2ca1-4c54-8559-9ea4dba9aee6', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:30:07.378649 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:30:07.379292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:30:07.380474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:30:07.380474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:30:07.380474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:30:07.390193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.390736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.391199 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.392002 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.392519 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.392979 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.417982 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for project e54623c55367410db8070615915e573e. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:30:07.425336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for user cbeabb83431b4536b4c5fdf71e8a5a80 and project e54623c55367410db8070615915e573e. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:30:07.495460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-937f7a20-ee89-49c7-a7c8-8a1335bad833 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: .version_select at 0x7f5ba46aed30>, body: {"keypair": {"name": "tempest-keypair-803678322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCboGNRe9VmMBjI2Hry41T74cVhPweIstHIu4c3biJFaMm8v4/B+S+aUWEZpKJhVfblsnWrerRDmfBaURyeFCRKtsqQESzzW51mGo5uIn42O9nPOULoJ1iMsg8KsybOZeg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:07.500429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:30:07.502992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='332805b6-f38d-4322-9a26-fa7fb2755652',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:30:07.515997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-937f7a20-ee89-49c7-a7c8-8a1335bad833 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:30:07.521721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-937f7a20-ee89-49c7-a7c8-8a1335bad833 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:30:07.549826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-937f7a20-ee89-49c7-a7c8-8a1335bad833 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058643 Aug 24 11:30:07.551272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 293/584] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:30:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:07.560562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:07.561513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:07.569024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.569570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.570010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.570783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.571495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.571929 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.692222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-37d85087-94e0-4986-ad19-6959f492c3de tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.956788 Aug 24 11:30:07.693863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 292/585] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:30:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:30:07.698964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:07.699630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:07.707908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.708665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.709319 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.710207 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.710824 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.711418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.756551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:30:07.811603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:07.852151 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:07.875146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ae500d80-3b4e-4a20-ae80-6fd6fe9a3c36 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1699 microversion: 2.1 time: 0.321457 Aug 24 11:30:07.876034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 294/586] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:07 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1699 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:07.879062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:07.890729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fcbbc89-842b-404d-b49c-379f6c619c80 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:07.891434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fcbbc89-842b-404d-b49c-379f6c619c80 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:07.901815 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a3393bd-e53e-4b3c-8d0a-6e8f9c66d414 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "DELETE /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 204 len: 0 microversion: 2.1 time: 0.205081 Aug 24 11:30:07.903184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 293/587] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:30:07 2022] DELETE /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:30:07.911193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-db2c51ec-04dd-4244-b74e-458b2cc6b55c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:07.920817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db2c51ec-04dd-4244-b74e-458b2cc6b55c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.921767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db2c51ec-04dd-4244-b74e-458b2cc6b55c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.922430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-db2c51ec-04dd-4244-b74e-458b2cc6b55c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.986003 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fcbbc89-842b-404d-b49c-379f6c619c80 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:07.994517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fcbbc89-842b-404d-b49c-379f6c619c80 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1093 microversion: 2.1 time: 0.116685 Aug 24 11:30:07.996573 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 295/588] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:07 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:08.001926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:08.002761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:08.013312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-db2c51ec-04dd-4244-b74e-458b2cc6b55c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Going to try to start instance {{(pid=120722) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:30:08.015755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.016700 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.018148 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.021776 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.022801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.023671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.079529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-db2c51ec-04dd-4244-b74e-458b2cc6b55c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action" status: 202 len: 0 microversion: 2.1 time: 0.173930 Aug 24 11:30:08.080666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 294/589] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:30:07 2022] POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:30:08.101690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:08.103596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:08.128503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.130484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.132052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.139787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.140656 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.141532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.242686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:08.257956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c0d57e6-3113-4281-8eb7-ae1245481d02 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1514 microversion: 2.1 time: 0.259737 Aug 24 11:30:08.259172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 296/590] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:07 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:08.381085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:08.391764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-39105e0d-45cc-4b29-ab28-ddf8d1a40089 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1708 microversion: 2.1 time: 0.302994 Aug 24 11:30:08.392521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 295/591] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:08 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1708 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:09.031076 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.031838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.039036 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.039526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.039958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.040661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.041111 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.041556 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.161510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.174683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-978d6285-bf31-4a41-a8b6-94ee180d1521 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1143 microversion: 2.1 time: 0.147135 Aug 24 11:30:09.183690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 297/592] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1143 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:09.284165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.285732 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.293080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.293763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.294200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.294907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.295364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.295918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.334084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1758421784", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f827975f-fb9d-4fba-ac33-57f23df4fae0"}], "security_groups": [{"name": "tempest-securitygroup--1719288232"}], "key_name": "tempest-keypair-803678322", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:09.491764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.492116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] validate_networks() for [('f827975f-fb9d-4fba-ac33-57f23df4fae0', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:30:09.502866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9ddf9e10-1dbb-424e-a080-4ef9a7f84b6a tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1514 microversion: 2.1 time: 0.224271 Aug 24 11:30:09.503844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 296/593] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:09.515042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.515042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.523874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.524405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.525723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.526535 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.527078 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.527900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.748678 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.758947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6af8e448-2947-4ec1-a374-3e67ab9ab76c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1708 microversion: 2.1 time: 0.251216 Aug 24 11:30:09.759559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 297/594] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1708 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:10.110698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:30:10.111785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:30:10.112272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:30:10.112690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:30:10.113332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:30:10.123252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.123850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.124352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.125320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.126551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.126726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.157005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:30:10.161421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:30:10.173073 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:30:10.175465 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:30:10.203154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:10.204897 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:10.213892 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.214387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.214958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.215800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.216258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.216719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.231840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20ef239b-0a45-4714-b123-d21bf7df3208 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.904199 Aug 24 11:30:10.232686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 298/595] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:30:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:30:10.247843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9243519-bd62-4b39-88fb-571829951c34 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:10.248750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9243519-bd62-4b39-88fb-571829951c34 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:10.306950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9243519-bd62-4b39-88fb-571829951c34 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:10.314381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9243519-bd62-4b39-88fb-571829951c34 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1241 microversion: 2.1 time: 0.070323 Aug 24 11:30:10.325543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 299/596] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:10 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:10.328310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:10.339574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-776c2936-f755-4874-9c1d-9e02fa9b1e30 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1191 microversion: 2.1 time: 0.140509 Aug 24 11:30:10.340269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 298/597] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:10 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1191 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:10.526955 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:10.527244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:10.540052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.540552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.540993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.541747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.549636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.563110 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.766250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-89993b9f-3447-441f-a435-33122ae600d7 req-fc7b39fe-3c9a-496d-9b26-98f842211d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a640d3-715a-4751-92dd-87e7b18744fd", "name": "network-vif-deleted", "tag": "48e70494-7a0c-493d-acc1-af46db8c7c5c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:10.786150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89993b9f-3447-441f-a435-33122ae600d7 req-fc7b39fe-3c9a-496d-9b26-98f842211d03 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.787547 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89993b9f-3447-441f-a435-33122ae600d7 req-fc7b39fe-3c9a-496d-9b26-98f842211d03 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.789834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-89993b9f-3447-441f-a435-33122ae600d7 req-fc7b39fe-3c9a-496d-9b26-98f842211d03 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.821537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-89993b9f-3447-441f-a435-33122ae600d7 req-fc7b39fe-3c9a-496d-9b26-98f842211d03 service nova] Creating event network-vif-deleted:48e70494-7a0c-493d-acc1-af46db8c7c5c for instance 23a640d3-715a-4751-92dd-87e7b18744fd on hv-cinder-85427 Aug 24 11:30:10.830310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-89993b9f-3447-441f-a435-33122ae600d7 req-fc7b39fe-3c9a-496d-9b26-98f842211d03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067145 Aug 24 11:30:10.832463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 299/598] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:10.838268 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:10.839543 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:10.848170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.849238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.849990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.850975 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.851989 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.852895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.857412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69e150421e412384d055f51eb71868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c968349e73bf45f48fdc00ba42989d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:10.869353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b80dd33-b156-49f8-a7f5-cef0b654f8ec tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 200 len: 1472 microversion: 2.1 time: 0.346719 Aug 24 11:30:10.869955 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 300/599] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:10 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:11.054701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:11.066982 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3f942812-a04a-4d74-8113-8077a10f86ba tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1708 microversion: 2.1 time: 0.232972 Aug 24 11:30:11.067567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 300/600] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:10 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1708 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:11.339976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:11.340657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:11.347308 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.347930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.348430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.349032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.349507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.349918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.361881 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:11.363196 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:11.370155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.370679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.371118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.371823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.372281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.372732 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.452913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:11.461885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-126cd372-70b5-4e11-a013-47b671bc577d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1209 microversion: 2.1 time: 0.103723 Aug 24 11:30:11.462622 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 301/601] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:11 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:11.473372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:11.483324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24f15ed5-0efe-47e1-83ac-5440734c2cef tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1237 microversion: 2.1 time: 0.147084 Aug 24 11:30:11.483942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 301/602] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:11 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:11.894805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:11.895709 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] [instance: 23a640d3-715a-4751-92dd-87e7b18744fd] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:11.905058 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.910186 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.910769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.911862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.912502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.913021 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.950535 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] HTTP exception thrown: Instance 23a640d3-715a-4751-92dd-87e7b18744fd could not be found. Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Request method failure captured: Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd HTTP/1.1 Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgsarmtCdJJUxNcTuVJPcz5fXUBJaqB0VKeHfIaIndlXk8ZzzN2mAphw3tZ66B28PAWwI_BQYmfPLlr0xPz5yo_0V_bOgp_UoyxZcxlb8KIzSdzbqYbPMgDWtGna5Wh0zJK6iD3gvSgi6IyuaI21RfHVCa48NiOHeQlOa4KRlWVQvAU Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: c968349e73bf45f48fdc00ba42989d8e Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1995391639 Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:30:11.953867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c968349e73bf45f48fdc00ba42989d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotTestJSON-1995391639 Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: c968349e73bf45f48fdc00ba42989d8e Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1995391639 Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotTestJSON-1995391639-project Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 9c69e150421e412384d055f51eb71868 Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotTestJSON-1995391639-project Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 23a640d3-715a-4751-92dd-87e7b18744fd could not be found. Aug 24 11:30:11.955417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '23a640d3-715a-4751-92dd-87e7b18744fd'} Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a640d3-715a-4751-92dd-87e7b18744fd could not be found. Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:30:11.956823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a640d3-715a-4751-92dd-87e7b18744fd could not be found. Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a640d3-715a-4751-92dd-87e7b18744fd could not be found. Aug 24 11:30:11.958345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:30:11.960350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] Returning 404 to user: Instance 23a640d3-715a-4751-92dd-87e7b18744fd could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:30:11.960350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0fcb0f2b-8ffb-426b-8e0d-ae4ee1088189 tempest-VolumesSnapshotTestJSON-1995391639 tempest-VolumesSnapshotTestJSON-1995391639-project] 10.222.0.17 "GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd" status: 404 len: 111 microversion: 2.1 time: 0.065957 Aug 24 11:30:11.963813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 302/603] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:11 2022] GET /compute/v2.1/servers/23a640d3-715a-4751-92dd-87e7b18744fd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:30:12.092189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:12.095078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:12.107219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.108568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.109615 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.111197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.111973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.120265 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.333161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:12.387545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ba5e76d-2285-4444-98bd-53cdc70e7762 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1708 microversion: 2.1 time: 0.301957 Aug 24 11:30:12.405581 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 302/604] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:12 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1708 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:12.490482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:12.492506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:12.510200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:12.511356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:12.520506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.521223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.521890 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.522751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.523303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.523916 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.533507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.535055 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.535674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.536822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.537542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.538241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.629830 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:12.640260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73787e7e-5b31-4855-a488-4cd402475685 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1301 microversion: 2.1 time: 0.137405 Aug 24 11:30:12.641089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 303/605] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:12 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1301 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:12.797538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:12.805774 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ba204658-3986-446d-b2d6-e2880afc2283 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.324776 Aug 24 11:30:12.806447 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 303/606] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:12 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:13.325881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-707800bd-1a98-4323-985b-3314c32d76a0 req-04b2f9b0-3915-46ea-8fb1-561a2d7971fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ca60a3-533e-48ea-a0f9-5fd4270c8164", "tag": "25d08f8b-13c5-422c-9daf-0dc66360742f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:13.339740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-707800bd-1a98-4323-985b-3314c32d76a0 req-04b2f9b0-3915-46ea-8fb1-561a2d7971fe service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.340395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-707800bd-1a98-4323-985b-3314c32d76a0 req-04b2f9b0-3915-46ea-8fb1-561a2d7971fe service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.341456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-707800bd-1a98-4323-985b-3314c32d76a0 req-04b2f9b0-3915-46ea-8fb1-561a2d7971fe service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.360548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-707800bd-1a98-4323-985b-3314c32d76a0 req-04b2f9b0-3915-46ea-8fb1-561a2d7971fe service nova] Creating event network-changed:25d08f8b-13c5-422c-9daf-0dc66360742f for instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 on hv-cinder-85427 Aug 24 11:30:13.366055 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-707800bd-1a98-4323-985b-3314c32d76a0 req-04b2f9b0-3915-46ea-8fb1-561a2d7971fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047830 Aug 24 11:30:13.366648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 304/607] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:13.416777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:13.417669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:13.424800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.436255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.436712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.437593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.438065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.438497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.665585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:13.668474 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:13.679884 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.680836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.681675 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.686118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.687092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.687908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.758263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:13.779594 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a2b1be69-300d-4aec-ad1c-08b8e7e87199 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1712 microversion: 2.1 time: 0.367218 Aug 24 11:30:13.781858 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 304/608] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:13 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1712 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:13.826973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:13.827591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:13.834736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.835224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.835659 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.836358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.836806 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.837242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.883218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:13.898681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b22a9537-89bf-474e-983a-d00930ff3ff7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1299 microversion: 2.1 time: 0.238161 Aug 24 11:30:13.899488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 305/609] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:13 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:14.158833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:14.167901 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d6064991-3968-4b8b-8a36-7c2d4d99a2db tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.344725 Aug 24 11:30:14.169241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 305/610] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:13 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:14.924950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:14.925993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:14.937063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:14.938218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:14.938828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:14.939867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:14.940963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:14.941549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.113660 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:15.121493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2bc9e3a7-3d20-4740-9494-cdba01804832 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.200416 Aug 24 11:30:15.122294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 306/611] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:14 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:15.192672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:15.193323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:15.200082 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:15.200568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:15.201000 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.201736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:15.202185 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:15.202610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.364810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:15.373016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-af4aecf2-6194-4ca6-97dc-7a2f27e43353 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.184871 Aug 24 11:30:15.373638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 306/612] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:15 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:16.143943 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:16.144568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:16.151190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.151673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.152105 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.152795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.153274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.153708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.301401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:16.309126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f665300-4944-42f7-bdae-99c1e210fcdf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.169127 Aug 24 11:30:16.309930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 307/613] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:16 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:16.395567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:16.396134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:16.402660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.403153 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.403584 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.404390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.404846 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.405408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.552612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:16.560568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d454baa1-b2f3-4ff9-b6c5-755fb44d61ad tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.169387 Aug 24 11:30:16.561135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 307/614] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:16 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:17.260324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8aea6d9c-b079-4eed-ac4c-696f74f76336 req-2911a9a6-47f2-4681-a2eb-b8fc6bdc5872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4aa9e46-2498-48fe-a81e-c661818bf0b2", "tag": "8106f287-bc66-43ad-b14a-071c682d54cf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:17.270541 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8aea6d9c-b079-4eed-ac4c-696f74f76336 req-2911a9a6-47f2-4681-a2eb-b8fc6bdc5872 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.271010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8aea6d9c-b079-4eed-ac4c-696f74f76336 req-2911a9a6-47f2-4681-a2eb-b8fc6bdc5872 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.271436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8aea6d9c-b079-4eed-ac4c-696f74f76336 req-2911a9a6-47f2-4681-a2eb-b8fc6bdc5872 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.285665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8aea6d9c-b079-4eed-ac4c-696f74f76336 req-2911a9a6-47f2-4681-a2eb-b8fc6bdc5872 service nova] Creating event network-changed:8106f287-bc66-43ad-b14a-071c682d54cf for instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 on hv-cinder-85427 Aug 24 11:30:17.293862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8aea6d9c-b079-4eed-ac4c-696f74f76336 req-2911a9a6-47f2-4681-a2eb-b8fc6bdc5872 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038923 Aug 24 11:30:17.294476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 308/615] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:17.334555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:17.335573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:17.342770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.343614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.344104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.345026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.345750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.346406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.402409 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:17.439677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:17.529242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:17.540151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a2113f93-a39a-4c93-89d9-711bca246ad9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.211074 Aug 24 11:30:17.540717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 308/616] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:17 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:17.583340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:17.584264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:17.592177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.593002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.593531 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.594332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.594846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.595381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.600914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:17.794010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:17.802079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53c58b44-5e89-4966-ad65-049f165a89b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.223516 Aug 24 11:30:17.802646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 309/617] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:17 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:18.565303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:18.566491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:18.574566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.575258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.575741 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.576529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.577177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.577877 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.733955 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:18.744033 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5adaa4fe-2190-40ed-98af-55c7db089d5d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.184030 Aug 24 11:30:18.744621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 309/618] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:18 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:18.830025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:18.830723 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:18.838286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.838774 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.839208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.840142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.840635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.841057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.990572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:18.998233 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e7bbbd6-ce2d-43fb-83e5-8d121a2baaf3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.172117 Aug 24 11:30:18.998808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 310/619] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:18 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:19.766875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:19.767663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:19.775584 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.776154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.776513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:19.777292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.777787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.778277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:19.783764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:19.933267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:19.942271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-049dfe86-d35e-4eae-817c-718cf75c1b4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.179355 Aug 24 11:30:19.942871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 310/620] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:19 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:20.032134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:20.032772 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:20.042871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.043377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.043815 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.044530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.045145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.045920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.135453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:20.210757 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:20.223245 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9e3e394-f0d7-4eca-bc4f-2edc6cd36d27 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.194762 Aug 24 11:30:20.223833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 311/621] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:20 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:20.967048 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:20.968069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:20.992254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.992874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.993028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.994230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.994639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.995293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:21.162717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:21.171164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-89c3bf28-2c3f-484b-a40e-453b7555dbde tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.209879 Aug 24 11:30:21.171733 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 311/622] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:20 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:21.241843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=14 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:21.247022 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:21.247629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:21.249401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:21.255958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:21.256437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:21.256867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:21.257591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:21.258035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:21.258447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:21.416487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:21.426039 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b624fc96-f342-4798-9d32-eeef5fdc1180 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.184041 Aug 24 11:30:21.426966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 312/623] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:21 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:22.194155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:22.194718 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:22.201552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:22.202217 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:22.202667 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:22.203357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:22.203804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:22.204214 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:22.344430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:22.353074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9224053-3fb7-4b59-ba99-a7c107e24186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.163598 Aug 24 11:30:22.353721 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 312/624] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:22 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:22.449027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:22.449625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:22.456387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:22.456868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:22.457332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:22.458034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:22.458480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:22.458896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:22.614544 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:22.624331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6c2bad6-d52a-4cbb-aeff-0bff3366d4fd tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.179199 Aug 24 11:30:22.624979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 313/625] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:22 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:23.375565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:23.376472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:23.383765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.384259 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.384695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.385435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.385888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.386306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.557050 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:23.567253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dd8f9123-68fb-411a-bcf5-a10e107cdb4c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.195541 Aug 24 11:30:23.567883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 313/626] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:23 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:23.650739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:23.651756 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:23.664386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.665482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.666325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.667804 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.668595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.669068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.831500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:23.843955 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6b98c14-f72f-4542-8ec3-7b0ed556e66f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.200642 Aug 24 11:30:23.844940 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 314/627] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:23 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:24.590808 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:24.591478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:24.600247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:24.600739 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:24.601167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:24.601904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:24.602356 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:24.602776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:24.867365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:24.868283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:24.880598 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:24.881609 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:24.882287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:24.883438 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:24.884191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:24.884893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:25.010368 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:25.020428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-20662967-d3d0-4d3d-bd0f-7b8ae5a151e6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.435240 Aug 24 11:30:25.021453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 314/628] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:24 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:25.080264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:25.093742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4d3a35f4-bd3f-4c21-a015-b720b5effa36 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.230293 Aug 24 11:30:25.097460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 315/629] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:24 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:26.049267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:26.050965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:26.058147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:26.058630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:26.059063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:26.059759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:26.060216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:26.060648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:26.115966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:26.116604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:26.124832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:26.125940 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:26.126382 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:26.127128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:26.127588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:26.128635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:26.247167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:26.263669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de8b1344-a874-497b-933d-8d6164e3948e tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.218969 Aug 24 11:30:26.264477 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 315/630] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:26 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:26.288453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:26.298603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63a8dfd1-8185-4a92-a78e-bda4f64403a4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.186981 Aug 24 11:30:26.299948 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 316/631] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:26 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:27.287400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:27.288222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:27.295838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:27.296333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:27.296774 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:27.297507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:27.297962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:27.298391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:27.322544 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:27.323231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:27.330262 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:27.331338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:27.332515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:27.333962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:27.334477 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:27.334916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:27.511068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:27.522147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f12fb756-c444-4bae-be32-5a3f755797c5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.239667 Aug 24 11:30:27.522926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 316/632] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:27 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:27.542138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:27.551617 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9511526-c9c2-4935-bdcd-3b5321af5a3a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.234297 Aug 24 11:30:27.552204 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 317/633] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:27 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:27.707559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-71ee4d72-760f-4cd1-a03c-74b2a069ba3c req-fa82376b-1d6a-47fd-b532-167f218210b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4aa9e46-2498-48fe-a81e-c661818bf0b2", "name": "network-vif-plugged", "status": "completed", "tag": "8106f287-bc66-43ad-b14a-071c682d54cf"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:27.728218 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-71ee4d72-760f-4cd1-a03c-74b2a069ba3c req-fa82376b-1d6a-47fd-b532-167f218210b0 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:27.729074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-71ee4d72-760f-4cd1-a03c-74b2a069ba3c req-fa82376b-1d6a-47fd-b532-167f218210b0 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:27.729866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-71ee4d72-760f-4cd1-a03c-74b2a069ba3c req-fa82376b-1d6a-47fd-b532-167f218210b0 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:27.746630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-71ee4d72-760f-4cd1-a03c-74b2a069ba3c req-fa82376b-1d6a-47fd-b532-167f218210b0 service nova] Creating event network-vif-plugged:8106f287-bc66-43ad-b14a-071c682d54cf for instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 on hv-cinder-85427 Aug 24 11:30:27.753468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-71ee4d72-760f-4cd1-a03c-74b2a069ba3c req-fa82376b-1d6a-47fd-b532-167f218210b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049372 Aug 24 11:30:27.753468 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 317/634] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:28.548877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:28.550197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:28.555969 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:28.556455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:28.556889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:28.557611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:28.558056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:28.558472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:28.576517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:28.577455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:28.584879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:28.585439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:28.585848 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:28.586561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:28.587019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:28.587448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:28.702211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:28.711931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82a3eb30-2d16-4826-b5ce-d9647eff369b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.167470 Aug 24 11:30:28.712522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 318/635] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:28 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:28.756011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:28.763838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7079b226-f9a0-4d4e-ab52-a725ead87044 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.191602 Aug 24 11:30:28.764423 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 318/636] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:28 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:29.739111 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:29.740185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:29.747942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:29.748440 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:29.748878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:29.749633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:29.750095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:29.750517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:29.776296 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-397a309a-a3e2-49e0-8c41-1df27ad174bb req-51c2b40d-39bc-4fa8-b4e7-8bf4dc109995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca60a3-533e-48ea-a0f9-5fd4270c8164", "name": "network-vif-plugged", "status": "completed", "tag": "25d08f8b-13c5-422c-9daf-0dc66360742f"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:29.794585 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-397a309a-a3e2-49e0-8c41-1df27ad174bb req-51c2b40d-39bc-4fa8-b4e7-8bf4dc109995 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:29.795438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-397a309a-a3e2-49e0-8c41-1df27ad174bb req-51c2b40d-39bc-4fa8-b4e7-8bf4dc109995 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:29.796213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-397a309a-a3e2-49e0-8c41-1df27ad174bb req-51c2b40d-39bc-4fa8-b4e7-8bf4dc109995 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:29.816108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-397a309a-a3e2-49e0-8c41-1df27ad174bb req-51c2b40d-39bc-4fa8-b4e7-8bf4dc109995 service nova] Creating event network-vif-plugged:25d08f8b-13c5-422c-9daf-0dc66360742f for instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 on hv-cinder-85427 Aug 24 11:30:29.824503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-397a309a-a3e2-49e0-8c41-1df27ad174bb req-51c2b40d-39bc-4fa8-b4e7-8bf4dc109995 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055371 Aug 24 11:30:29.825586 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 319/637] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:29.835686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:29.836924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:29.848879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:29.849760 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:29.850483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:29.851596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:29.852286 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:29.852934 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:29.929891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:29.943453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b554736-96a6-4619-9981-6759cd2cd5b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1367 microversion: 2.1 time: 0.212584 Aug 24 11:30:29.945737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 319/638] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:29 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:30.053588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:30.061779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-917357a6-50fe-46a1-baf2-561f63c5233c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.234227 Aug 24 11:30:30.062362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 320/639] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:29 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:30.968830 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:30.969962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:30.977415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:30.977904 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:30.978338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:30.979066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:30.979538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:30.980070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:31.086606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:31.087746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:31.095565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:31.096213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:31.096756 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:31.097631 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:31.098377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:31.099089 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:31.145536 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:31.153855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5021115-d79e-4d22-b037-7ca834869ddf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1557 microversion: 2.1 time: 0.191559 Aug 24 11:30:31.154837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 320/640] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:30 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:31.179796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:31.180454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:31.189246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:31.191298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:31.191832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:31.192639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:31.193178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:31.193668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:31.259237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:31.269092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8398c317-c24a-4196-833f-7b0c6aa32037 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1264 microversion: 2.1 time: 0.187159 Aug 24 11:30:31.269092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 321/641] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:31 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:31.318136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a800abea-96a5-483d-9cd7-a27460ac92fa tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142807 Aug 24 11:30:31.318842 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 321/642] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:30:31 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:31.764227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e5d7ffe-62d9-407f-9838-6f2da9da1c22"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:31.767921 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:31.778680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:31.779386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:31.780037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:31.780880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:31.781564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:31.782256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:32.289301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:32.290175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:32.297130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:32.297650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:32.298080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:32.298787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:32.299230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:32.300654 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:32.651309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:32.669928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d3dacf40-5d26-43e1-af77-d292ea62c77a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1451 microversion: 2.1 time: 0.385254 Aug 24 11:30:32.671107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 322/643] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:32 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1451 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:32.680618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-de93e1a8-22e8-4fce-b3d7-555a2bd3bbbd req-23b19909-e053-4820-8d1b-7ed358ec09c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4aa9e46-2498-48fe-a81e-c661818bf0b2", "tag": "8106f287-bc66-43ad-b14a-071c682d54cf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:32.692584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-de93e1a8-22e8-4fce-b3d7-555a2bd3bbbd req-23b19909-e053-4820-8d1b-7ed358ec09c5 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:32.693493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-de93e1a8-22e8-4fce-b3d7-555a2bd3bbbd req-23b19909-e053-4820-8d1b-7ed358ec09c5 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:32.693928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-de93e1a8-22e8-4fce-b3d7-555a2bd3bbbd req-23b19909-e053-4820-8d1b-7ed358ec09c5 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:32.707447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-de93e1a8-22e8-4fce-b3d7-555a2bd3bbbd req-23b19909-e053-4820-8d1b-7ed358ec09c5 service nova] Creating event network-changed:8106f287-bc66-43ad-b14a-071c682d54cf for instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 on hv-cinder-85427 Aug 24 11:30:32.709086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57e40b4e-1a8a-48e9-bd12-1d423b1659f1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.950089 Aug 24 11:30:32.710669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 322/644] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:30:31 2022] POST /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:32.717723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:32.722529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:32.742188 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-de93e1a8-22e8-4fce-b3d7-555a2bd3bbbd req-23b19909-e053-4820-8d1b-7ed358ec09c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069036 Aug 24 11:30:32.743010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 323/645] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:32.756144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:32.757747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:32.759337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:32.761129 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:32.762642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:32.763643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:32.997226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:33.014337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-392145a4-498c-4457-985c-9a06ffd862b2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1451 microversion: 2.1 time: 0.301443 Aug 24 11:30:33.015637 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 323/646] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:32 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1451 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:35.391090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-458e37d6-7edb-49b9-b00d-59a1bace11bc req-a183c853-dc01-4543-8d37-062c4392841c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ca60a3-533e-48ea-a0f9-5fd4270c8164", "tag": "25d08f8b-13c5-422c-9daf-0dc66360742f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:35.403856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-458e37d6-7edb-49b9-b00d-59a1bace11bc req-a183c853-dc01-4543-8d37-062c4392841c service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:35.404320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-458e37d6-7edb-49b9-b00d-59a1bace11bc req-a183c853-dc01-4543-8d37-062c4392841c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:35.404778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-458e37d6-7edb-49b9-b00d-59a1bace11bc req-a183c853-dc01-4543-8d37-062c4392841c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:35.433165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-458e37d6-7edb-49b9-b00d-59a1bace11bc req-a183c853-dc01-4543-8d37-062c4392841c service nova] Creating event network-changed:25d08f8b-13c5-422c-9daf-0dc66360742f for instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 on hv-cinder-85427 Aug 24 11:30:35.440828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-458e37d6-7edb-49b9-b00d-59a1bace11bc req-a183c853-dc01-4543-8d37-062c4392841c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054883 Aug 24 11:30:35.441521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 324/647] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:40.138355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:40.139311 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:40.148614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=62 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:40.171190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.171879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.172524 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.175992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.176844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.177905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.263050 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cfdd2ac0-3cf1-40f7-89ca-10640703519c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments/e7918736-f029-4026-90be-a1978577e7c7" status: 200 len: 194 microversion: 2.20 time: 0.132655 Aug 24 11:30:40.267310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 324/648] 10.222.0.17 () {60 vars in 1454 bytes} [Wed Aug 24 11:30:40 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments/e7918736-f029-4026-90be-a1978577e7c7 => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:30:40.429734 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:40.430608 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:40.446281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.446888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.447403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.451847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.452439 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.452983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.677732 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:40.684411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:40.696547 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.698158 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.698824 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.699944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.700758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.701493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.722437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lazy-loading 'services' on Instance uuid 18aa3b17-222c-4330-a1fd-72ee1a96c82e {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:30:40.747762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lazy-loading 'flavor' on Instance uuid 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:30:40.929434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cdab872b-6c53-47d6-82c8-eaac23ddb0e7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments/e7918736-f029-4026-90be-a1978577e7c7" status: 202 len: 0 microversion: 2.20 time: 0.505677 Aug 24 11:30:40.935197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 325/649] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Aug 24 11:30:40 2022] DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments/e7918736-f029-4026-90be-a1978577e7c7 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:30:40.969190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:40.970682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:40.971204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:40.986081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.986411 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.987593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.989121 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.989121 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.989439 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:41.052424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:41.105409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-349560a3-7281-49fb-a080-52785e5d66d1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.153381 Aug 24 11:30:41.106996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 326/650] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 11:30:40 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:30:41.111968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ec24d07-66df-47c0-b526-6e72f1ad902e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/action" status: 200 len: 32 microversion: 2.1 time: 0.419399 Aug 24 11:30:41.118816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 325/651] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:30:40 2022] POST /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:30:41.129630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:41.130770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:41.147227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:41.150102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:41.150971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:41.152253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:41.153119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:41.154046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:41.523370 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:41.537820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7dd13762-e96b-4f1c-9059-e4c37b18b1b0 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.416807 Aug 24 11:30:41.539064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 327/652] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:41 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:42.122616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:42.124880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:42.138312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:42.139233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:42.139902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:42.140935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:42.141709 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:42.142357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:42.213686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f62c001c-1bd6-4fb6-844c-4bcc56808693 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095076 Aug 24 11:30:42.220275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 326/653] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 11:30:42 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:30:42.568083 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:42.569294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:42.587436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:42.588663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:42.589350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:42.590362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:42.591053 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:42.591543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:42.947105 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:42.959622 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16e6c2a8-6780-4287-87ca-4722998c8521 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.395412 Aug 24 11:30:42.960220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 328/654] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:42 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:43.238330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:43.242837 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:43.256121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:43.257021 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:43.257021 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:43.258465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:43.261801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:43.262255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:43.312033 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e07bdd34-4f57-48fb-bd87-c75f0c777cd3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083259 Aug 24 11:30:43.313451 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 327/655] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 11:30:43 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:43.426354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:43.427139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:43.434605 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:43.435400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:43.436059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:43.437086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:43.437759 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:43.438738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:43.472345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:30:43.603412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1d86c15-e3e5-4e95-9549-f8f15660d846 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 204 len: 0 microversion: 2.20 time: 0.174012 Aug 24 11:30:43.607015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 329/656] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 11:30:43 2022] DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:30:43.616603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:43.621663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:43.631562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:43.632323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:43.648758 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:43.650730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:43.651703 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:43.652438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:43.894684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:43.907626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:43.909413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:43.910693 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da0f95c1-a8e5-4afc-93ca-4510bfb36ea7 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.299674 Aug 24 11:30:43.911825 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 328/657] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:43 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:30:43.982984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:43.983740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:44.003202 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:44.004512 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:44.004512 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:44.005530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:44.006066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:44.007281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:44.243999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:44.266773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-60cbfd34-64da-460c-b20a-8e004e03b8ca tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.286652 Aug 24 11:30:44.278952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 330/658] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:43 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:44.943484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:44.944254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:44.952569 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:44.953375 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:44.953894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:44.955173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:44.955337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:44.956255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:45.166113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:45.182155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:45.183974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:45.188148 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d5fd264-c446-4f4c-9f5f-bc0c1c4dcbbb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.250134 Aug 24 11:30:45.193246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 329/659] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:44 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:45.311122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:45.312299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:45.321476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:45.322310 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:45.322973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:45.324658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:45.325712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:45.326698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:45.557604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:45.571930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82f36550-bd75-4d04-a8d6-19cdb7946f76 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.267485 Aug 24 11:30:45.573065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 331/660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:45 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:46.221429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:46.229356 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:46.241640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:46.243937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:46.244574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:46.248714 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:46.249192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:46.250948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:46.556124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:46.572270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:46.574631 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:46.577670 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-90028fdd-18bb-4e04-9a7a-721ba8ccccf8 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1722 microversion: 2.20 time: 0.363481 Aug 24 11:30:46.585016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 330/661] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:46 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:46.604044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:46.605085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:46.620222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:46.621271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:46.622200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:46.624917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:46.625880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:46.626661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.239656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:47.262484 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b425fee-2322-446a-8d62-45b896e309ff tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.670162 Aug 24 11:30:47.268067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 332/662] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:46 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:47.381927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3e284b07-fed3-4f3c-9bd3-8570f03799f7 req-d0976b86-b64a-4dff-887a-69204df69af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aa3b17-222c-4330-a1fd-72ee1a96c82e", "name": "network-vif-deleted", "tag": "688ffd83-693c-4640-abaf-336a96b9c75e"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:47.403515 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3e284b07-fed3-4f3c-9bd3-8570f03799f7 req-d0976b86-b64a-4dff-887a-69204df69af7 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.409473 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3e284b07-fed3-4f3c-9bd3-8570f03799f7 req-d0976b86-b64a-4dff-887a-69204df69af7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.411166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3e284b07-fed3-4f3c-9bd3-8570f03799f7 req-d0976b86-b64a-4dff-887a-69204df69af7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.464793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3e284b07-fed3-4f3c-9bd3-8570f03799f7 req-d0976b86-b64a-4dff-887a-69204df69af7 service nova] Creating event network-vif-deleted:688ffd83-693c-4640-abaf-336a96b9c75e for instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e on hv-cinder-85427 Aug 24 11:30:47.472300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3e284b07-fed3-4f3c-9bd3-8570f03799f7 req-d0976b86-b64a-4dff-887a-69204df69af7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095915 Aug 24 11:30:47.478353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 331/663] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:47.607106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:47.607926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:47.626461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.628456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.630416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.633610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.634399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.635366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.713721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:47.714566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:47.715203 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:47.715833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lazy-loading 'fault' on Instance uuid 18aa3b17-222c-4330-a1fd-72ee1a96c82e {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:30:47.803963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:47.819230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:47.828008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:47.829890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f63aa914-ca57-411d-8273-9acd6a5e1a4c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 200 len: 1372 microversion: 2.20 time: 0.227932 Aug 24 11:30:47.849235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 333/664] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:47 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:48.295091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:48.296324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:48.320700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:48.321890 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:48.325326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:48.327973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:48.330951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:48.332814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:48.716121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:48.738719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1a44fcf5-4362-44df-9362-bac15a8745d5 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.449784 Aug 24 11:30:48.739474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 332/665] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:48 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:48.874627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:48.888887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:48.926237 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:48.926996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:48.928505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:48.929858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:48.930523 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:48.931147 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:48.986249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] HTTP exception thrown: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Request method failure captured: Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e HTTP/1.1 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgridhnWMGT28Z2E9ps2mtY3Kz5KszNqidiRAQaptjY9xxTiRQ5i06GrlCkZ--fA6MIOj6Nw1TJV0L47vv5lQt2vNJ_aWberl7R4lkIiNx2DlR4SEsReFbVmRfbSlsY1tJGv2IenenbR0M97znpnWEsIDlYfo1MNl7sZpSBU9nvOMCo Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:30:48.990225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 6a2bfeaa15ee4ef3bcaa21e22c71895d Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:30:48.991859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '18aa3b17-222c-4330-a1fd-72ee1a96c82e'} Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:30:48.992584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:30:48.993831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:30:48.996832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Returning 404 to user: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:30:48.996832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9feed469-fd94-4af5-b2aa-57e10a51522f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 404 len: 111 microversion: 2.20 time: 0.139208 Aug 24 11:30:48.996832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 334/666] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:48 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:30:49.002602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-97481979-f3d8-490f-ba0d-c5217cb4f18a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '.version_select at 0x7f5ba8fd99d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:49.052990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-97481979-f3d8-490f-ba0d-c5217cb4f18a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079084680" status: 204 len: 0 microversion: 2.20 time: 0.054482 Aug 24 11:30:49.056750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 333/667] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Aug 24 11:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079084680 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:30:49.765681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:49.766585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:49.778672 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:49.779577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:49.780400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:49.781448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:49.782297 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:49.782902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:50.122839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:50.146919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c942e67-1928-4cd5-8f84-f046b43e4399 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.385075 Aug 24 11:30:50.147805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 335/668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:49 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:50.314304 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1e5e58d6-6211-4347-861e-745c2903a3a1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'create', calling method: .version_select at 0x7f5ba8fcb040>, body: {"keypair": {"name": "tempest-keypair-2007654522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPnAf1jO9/7CKrUFqhVyN48AS4TyBUh0wHyEgdMEsiYQia1kD41In1NAMgxnEdKXY8EiTpoJXqQ1LaZzG46zCWX42V4jqvGhmDcxKx7BrOPp/B+a5v7Q+Bs5RBjwpwx1w=="}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:50.347930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-1e5e58d6-6211-4347-861e-745c2903a3a1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:30:50.352842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-1e5e58d6-6211-4347-861e-745c2903a3a1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for user 6a2bfeaa15ee4ef3bcaa21e22c71895d and project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'key_pairs'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:30:50.400394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1e5e58d6-6211-4347-861e-745c2903a3a1 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.094982 Aug 24 11:30:50.401266 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 334/669] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Aug 24 11:30:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 11:30:51.186776 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:51.187777 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:51.207151 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:51.207991 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:51.208690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:51.209909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:51.210889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:51.211569 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:51.500941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:51.512578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7b1c6ce-2414-4a0c-96ea-b189f244bbba tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.331213 Aug 24 11:30:51.514152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 336/670] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:51 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:52.540029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:52.542275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:52.558800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:52.559517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:52.560279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:52.561348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:52.562165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:52.562766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:52.929363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:52.945426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e480352-6d52-45ba-959b-b77de6efadfa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.411874 Aug 24 11:30:52.959848 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 335/671] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:52 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:53.692573 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-305820761", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7895ab0-bf6d-488a-8b51-ae8134e3afb6"}], "security_groups": [{"name": "tempest-securitygroup--1067593641"}], "key_name": "tempest-keypair-2007654522", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:53.702708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:53.840530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] validate_networks() for [('f7895ab0-bf6d-488a-8b51-ae8134e3afb6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:30:53.978997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:53.980343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:53.988252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:53.989312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:53.989961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:53.990873 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:53.991492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:53.992417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:54.216998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:54.228897 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94437ee1-0e9d-45ec-b9dc-dc3c0f4a789e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.258094 Aug 24 11:30:54.230691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 336/672] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:53 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:54.362948 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:30:54.363378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:30:54.363880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:30:54.364272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:30:54.364683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:30:54.373973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:54.374455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:54.375100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:54.376042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:54.376696 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:54.377084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:54.398585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:30:54.403737 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Getting quotas for user 6a2bfeaa15ee4ef3bcaa21e22c71895d and project 9e0d25ef91a84ff4a1afc307daded734. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:30:54.420658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:30:54.423477 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:30:54.496810 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-78c0ead9-95e5-4a49-928a-215a627bafb0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.809197 Aug 24 11:30:54.497528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 337/673] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Aug 24 11:30:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 11:30:54.509960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9d11efcd-b24d-4797-81b8-704dfdb12923 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:54.513810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9d11efcd-b24d-4797-81b8-704dfdb12923 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:54.600453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d11efcd-b24d-4797-81b8-704dfdb12923 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:54.608252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d11efcd-b24d-4797-81b8-704dfdb12923 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:54.609985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9d11efcd-b24d-4797-81b8-704dfdb12923 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:54.612436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9d11efcd-b24d-4797-81b8-704dfdb12923 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1281 microversion: 2.20 time: 0.105670 Aug 24 11:30:54.613235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 337/674] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:54 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:55.257504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:55.258279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:55.278095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:55.278762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:55.279209 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:55.279996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:55.280607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:55.281038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:55.390264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:55.391858 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:55.406122 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:55.407395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:55.408754 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:55.410018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:55.410809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:55.411998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:55.514157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:55.528891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2519f1c2-f696-410e-9d9b-d5da9e933934 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.277999 Aug 24 11:30:55.534115 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 338/675] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:55 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:55.562151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lazy-loading 'services' on Instance uuid 040f5a2c-3c12-4b35-bdc5-91a6d497c066 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:30:55.637324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:55.638483 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:55.654563 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:55.655636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:55.656453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:55.657704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:55.659441 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:55.660941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:55.725861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe68d3b9-2928-4799-8aa0-b3faaddedcae tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-volume_attachments/505d102a-1398-43a2-9e8e-0a5e46e8ea8d" status: 202 len: 0 microversion: 2.1 time: 0.338175 Aug 24 11:30:55.741286 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 338/676] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:30:55 2022] DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-volume_attachments/505d102a-1398-43a2-9e8e-0a5e46e8ea8d => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:30:55.762487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:55.785241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:55.788214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:55.789396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f35b0b3-2aad-4475-8c91-464f557bc777 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1333 microversion: 2.20 time: 0.158007 Aug 24 11:30:55.791041 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 339/677] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:55 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1333 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:56.558143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:56.558910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:56.570537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:56.571033 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:56.571470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:56.572181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:56.572626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:56.573053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:56.818893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:56.820102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:56.827416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:56.828193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:56.829013 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:56.830515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:56.831143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:56.831720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:56.908366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:56.920121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-127528ba-62aa-488f-96c4-549fe5d8929c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.368244 Aug 24 11:30:56.940148 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 339/678] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:56 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:56.981334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:56.992664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:56.994434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:56.995769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-079ea763-507c-4f1f-9f08-be89ca1cc492 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1339 microversion: 2.20 time: 0.180923 Aug 24 11:30:57.007015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 340/679] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:56 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:57.947817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:57.948435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:57.962614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:57.963222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:57.963672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:57.964394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:57.964855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:57.965314 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.021061 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:58.022333 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:58.037156 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:58.044160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:58.044879 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.046906 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:58.047612 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:58.049362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.200593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:58.216582 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b1e4855a-709e-4ad0-a920-519fc0855575 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.272518 Aug 24 11:30:58.219893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 340/680] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:57 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:58.228156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dcc09927-9b7c-40d7-8ef6-675ea3fa45f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:58.238783 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc09927-9b7c-40d7-8ef6-675ea3fa45f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:58.239725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc09927-9b7c-40d7-8ef6-675ea3fa45f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:58.240635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dcc09927-9b7c-40d7-8ef6-675ea3fa45f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.297249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dcc09927-9b7c-40d7-8ef6-675ea3fa45f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Going to try to stop instance {{(pid=120722) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:30:58.368306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dcc09927-9b7c-40d7-8ef6-675ea3fa45f0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action" status: 202 len: 0 microversion: 2.1 time: 0.146306 Aug 24 11:30:58.371439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 341/681] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:30:58 2022] POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:30:58.390203 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:58.403233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:58.406422 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:58.414947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:58.422975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:58.428063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dfe353e-4fb1-4bf9-abc5-8e969de0776b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.411925 Aug 24 11:30:58.430978 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 341/682] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:58 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:30:58.435095 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:58.436466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:58.444097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.445284 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:58.446090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:58.446860 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.763180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:58.776200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f6a5b7b-ea8a-4c0f-ac72-6577abd31850 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.400186 Aug 24 11:30:58.784168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 342/683] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:58 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:58.837597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ecded867-76ba-4389-8e99-51955ff23df8 req-0fa25b84-29a0-4bf1-a2f0-bcc07262d3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:58.855859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ecded867-76ba-4389-8e99-51955ff23df8 req-0fa25b84-29a0-4bf1-a2f0-bcc07262d3e4 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:58.856616 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ecded867-76ba-4389-8e99-51955ff23df8 req-0fa25b84-29a0-4bf1-a2f0-bcc07262d3e4 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:58.857392 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ecded867-76ba-4389-8e99-51955ff23df8 req-0fa25b84-29a0-4bf1-a2f0-bcc07262d3e4 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:58.881145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ecded867-76ba-4389-8e99-51955ff23df8 req-0fa25b84-29a0-4bf1-a2f0-bcc07262d3e4 service nova] Creating event network-changed:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:30:58.888880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ecded867-76ba-4389-8e99-51955ff23df8 req-0fa25b84-29a0-4bf1-a2f0-bcc07262d3e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055060 Aug 24 11:30:58.889503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 342/684] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:59.249524 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:59.250513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:59.259750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:59.262242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:59.262747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:59.266957 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:59.267523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:59.267965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:59.297678 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:59.457351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:59.482216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4731d9d9-13d4-4d5a-8fea-a62e923708ac tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.242211 Aug 24 11:30:59.493324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:59.494752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:59.502950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:59.504101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:59.505449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:59.506753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 343/685] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:59 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:59.507123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:59.507809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:59.508299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:59.533258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:59.777346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:59.800872 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:59.804772 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:59.805427 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:59.805683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:59.806850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d58ec6ff-ec87-4f27-a142-b33e4dd59219 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.347601 Aug 24 11:30:59.813732 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 343/686] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:30:59 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:30:59.817456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:59.818026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:59.818500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:59.819243 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:59.819717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:59.820134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:00.024836 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:00.043459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5947112b-c43a-43e7-8a3c-afa9d470ae8c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.242500 Aug 24 11:31:00.044354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 344/687] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:59 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:00.513939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:00.515177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:00.531588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:00.532385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:00.533640 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:00.534553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:00.535198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:00.535813 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:00.732738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:00.742370 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-52fef762-7f9d-4ff5-8c50-879da87386aa tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.232269 Aug 24 11:31:00.743793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 344/688] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:00 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:00.849012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:00.850643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:00.860115 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:00.861191 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:00.861840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:00.862936 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:00.863660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:00.864328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:01.075957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:01.076997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:01.086830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:01.087746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:01.088487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:01.089167 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:01.090262 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:01.091479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:01.092215 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:01.101588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:01.102962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:01.105016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03cee356-1fd5-4e0d-8127-bc0a5d04c5f3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.264708 Aug 24 11:31:01.106044 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 345/689] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:00 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:01.277653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:01.287269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e471cbd7-0943-4011-981f-a2a295088703 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.215520 Aug 24 11:31:01.288421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 345/690] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:01 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:01.766327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:01.766933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:01.773801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:01.774441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:01.774878 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:01.775837 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:01.776623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:01.776623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:01.985083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:01.996351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b59b2f7e-e09c-4709-a4e5-2055dd3c0f7d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.234146 Aug 24 11:31:01.996952 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 346/691] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:01 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:02.133240 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:02.133821 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:02.141165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:02.141614 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:02.142959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:02.144130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:02.144614 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:02.145054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:02.313171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:02.314679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:02.335227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:02.335227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:02.335227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:02.336159 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:02.338369 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:02.338369 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:02.358989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:02.378748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:02.378748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:02.378748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eef266e4-5f06-408e-87c5-3ac0c5a25321 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.246421 Aug 24 11:31:02.379180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 346/692] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:02 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:31:02.536441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:02.550362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2302333-46b4-4db3-855f-75a568c702d6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.240634 Aug 24 11:31:02.551456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 347/693] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:02 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:03.023282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:03.024876 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:03.040051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:03.040755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:03.041436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:03.042670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:03.043760 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:03.044771 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:03.254538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:03.265410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-584cc3cb-e358-4827-af01-1c9af406447e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.249549 Aug 24 11:31:03.266549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 347/694] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:03 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:03.400320 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:03.401129 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:03.412179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:03.413109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:03.414793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:03.416179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:03.416642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:03.417387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:03.572848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:03.573986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:03.585451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:03.589148 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:03.589880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:03.592052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:03.592878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:03.597025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:03.650247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:03.660154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:03.661946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:03.663350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5cbede24-6afe-4825-8cc9-b8de18400859 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.267030 Aug 24 11:31:03.664389 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 348/695] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:03 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:31:03.803472 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:03.812528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11c440aa-bfe4-4913-b127-0e2eb38ab5d9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.244350 Aug 24 11:31:03.814865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 348/696] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:03 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:04.288931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:04.289734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:04.302629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:04.303391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:04.304057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:04.305156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:04.305831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:04.306617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:04.492559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:04.502497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-96242dfa-55ed-40d6-99c1-5af7742ebbf4 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.217077 Aug 24 11:31:04.503466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 349/697] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:04 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:04.691834 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:04.692331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:04.696013 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:04.696976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:04.704145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:04.705274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:04.706251 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:04.707232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:04.707856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:04.708491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:04.844057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:04.847030 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:04.849124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:04.855496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:04.856442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:04.856988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:04.857842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:04.858395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:04.859047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:04.990249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:05.001821 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:05.003828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:05.005447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2e9b557-3901-4063-b329-b25f50391fc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.318594 Aug 24 11:31:05.006565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 349/698] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:04 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:05.028291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:05.038436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86a9aa66-f5c5-452d-a2ee-787f7843a6a6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.197801 Aug 24 11:31:05.044422 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 350/699] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:04 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:05.526468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:05.527418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:05.534539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:05.535038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:05.535572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:05.536264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:05.536736 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:05.537167 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:05.690416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:05.699780 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-68470da2-04d6-4cae-939d-0e75ea6054df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.176934 Aug 24 11:31:05.715658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 350/700] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:05 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:05.905674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-96f88327-ef11-4980-b134-ed83dff3407d req-3dafa3ca-d278-4ac8-b6da-0a3aabf403ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "name": "network-vif-plugged", "status": "completed", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:05.918370 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-96f88327-ef11-4980-b134-ed83dff3407d req-3dafa3ca-d278-4ac8-b6da-0a3aabf403ff service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:05.918882 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-96f88327-ef11-4980-b134-ed83dff3407d req-3dafa3ca-d278-4ac8-b6da-0a3aabf403ff service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:05.919311 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-96f88327-ef11-4980-b134-ed83dff3407d req-3dafa3ca-d278-4ac8-b6da-0a3aabf403ff service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:05.932132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-96f88327-ef11-4980-b134-ed83dff3407d req-3dafa3ca-d278-4ac8-b6da-0a3aabf403ff service nova] Creating event network-vif-plugged:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:31:05.937570 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-96f88327-ef11-4980-b134-ed83dff3407d req-3dafa3ca-d278-4ac8-b6da-0a3aabf403ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036160 Aug 24 11:31:05.938529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 351/701] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:05.997302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f5414fc-6784-4737-ab85-d50c0084741a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Action: 'create', calling method: .version_select at 0x7f5ba471b3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-432744994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6tiG1J5e1wMmO8O0YCsz3l8LPLCxZY3HyufgWVTloKexR25cs517QmLY2UNdCsOyRtOM/NQAmMwXLnvf3Ncz5opJwrbDfnIR5JtcL7M6+KaIWsm7mcQTy19Uelk5BxA=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:06.013368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-2f5414fc-6784-4737-ab85-d50c0084741a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Getting quotas for project eca9f8790d884a86a4abb64ab33b4d42. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:06.018004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-2f5414fc-6784-4737-ab85-d50c0084741a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Getting quotas for user bf7576ede68e40c5bc137774e67724bb and project eca9f8790d884a86a4abb64ab33b4d42. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:06.033604 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:06.034324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:06.041862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.042604 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.043391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.043540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f5414fc-6784-4737-ab85-d50c0084741a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049966 Aug 24 11:31:06.044088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 351/702] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:31:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:06.044640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.045378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.046003 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.060308 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:06.061452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:06.069527 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.070026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.070463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.071172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.071623 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.073419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.204439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:06.212918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:06.214457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:06.215705 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1715dd02-766a-4380-b541-5e5fb89d8543 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.187647 Aug 24 11:31:06.222344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 352/703] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:06 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:31:06.230481 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1796545361", "imageRef": "4c7bf6e7-09ae-4e35-a1c6-656f5be18ab2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-432744994", "networks": [{"uuid": "56654171-55a6-4855-822d-336db9afbf3e"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:06.264212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:06.277326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b969668-39ba-42dd-89d8-3668ff794ca0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.221230 Aug 24 11:31:06.278134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 352/704] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:06 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:06.297503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] validate_networks() for [('56654171-55a6-4855-822d-336db9afbf3e', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:06.679359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:06.679782 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:06.680263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:06.680675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:06.681091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:06.690571 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.691072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.691491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.692214 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.692665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.693086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.710174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Getting quotas for project eca9f8790d884a86a4abb64ab33b4d42. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:06.714177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Getting quotas for user bf7576ede68e40c5bc137774e67724bb and project eca9f8790d884a86a4abb64ab33b4d42. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:06.722871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:06.723495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:06.725699 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:06.727923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c7bf6e7-09ae-4e35-a1c6-656f5be18ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:06.729882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.730364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.730845 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.731481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:06.731924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:06.732340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:06.778499 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0db44306-f357-45bd-bddf-7d70abd2d613 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554066 Aug 24 11:31:06.779135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 353/705] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:31:06.790347 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ef26758b-cf06-4a84-aa7a-7632b6bb6fcd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:06.790965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ef26758b-cf06-4a84-aa7a-7632b6bb6fcd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:06.845766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ef26758b-cf06-4a84-aa7a-7632b6bb6fcd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:06.852988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ef26758b-cf06-4a84-aa7a-7632b6bb6fcd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1258 microversion: 2.1 time: 0.066838 Aug 24 11:31:06.853834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 354/706] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:06 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:06.941284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:06.952193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-afd670f7-dfff-41dd-b7ae-096bb99b4a3f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1736 microversion: 2.1 time: 0.233217 Aug 24 11:31:06.961996 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 353/707] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:06 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:07.241986 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:07.242773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:07.249399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.249880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.250316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.251022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.251601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.252089 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.298724 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:07.300178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:07.305273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.305764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.306192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.306896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.307348 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.307771 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.411620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:07.420579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:07.422119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:07.424047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c3ba19eb-3c74-4898-aa71-a4b99d189bff tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.188094 Aug 24 11:31:07.427713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 355/708] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:07 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:07.448698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:07.460361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b493397-f65a-41e2-9588-a427c6b57cc7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.165634 Aug 24 11:31:07.460954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 354/709] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:07 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:07.874459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:07.875072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:07.882321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.882917 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.883359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.884064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.884519 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.884998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.954056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:07.964466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94b414a1-d177-48f6-9ab3-55fa0e5ab032 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1262 microversion: 2.1 time: 0.093915 Aug 24 11:31:07.971097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 356/710] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:07 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:07.978405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:07.979703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:07.991739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.993277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.993277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:07.994230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:07.994923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:07.995434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.152779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:08.161435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5badd143-f689-4aff-bae3-6aa5b298853f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1716 microversion: 2.1 time: 0.190213 Aug 24 11:31:08.162017 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 355/711] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:07 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1716 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:08.278904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:08.279439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:08.287189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.287670 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.288110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.288831 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.289355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.289787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.375293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] HTTP exception thrown: Cannot 'detach_volume' instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c while it is in vm_state rescued Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Request method failure captured: Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments/4e5d7ffe-62d9-407f-9838-6f2da9da1c22 HTTP/1.1 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrhz4gfHQU5F4BnbUrdMt4WvJrVKE326M2yKdG7ug6Zhfb5tlFsGbS8RBWl0IB6CA6GP6gejXKiplrbCPi7U-5iqCSIS09L1d3J_GrtWlp4FenA1OQmHXvTDAxoPAyKHcvefMTruSghEIXli1ol3_s2nbKmvMYHvn18His6ubYUa08 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:31:08.376931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 6f7224ed18ba423084846da68a920f52 Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:31:08.378568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Cannot 'detach_volume' instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c while it is in vm_state rescued Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'server_id': '4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c', 'id': '4e5d7ffe-62d9-407f-9838-6f2da9da1c22'} Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:08.379273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c while it is in vm_state rescued Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c while it is in vm_state rescued Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:31:08.380855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Returning 409 to user: Cannot 'detach_volume' instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c while it is in vm_state rescued {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:08.382040 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aae66c7f-7f98-4519-be5c-7855dc394d3d tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments/4e5d7ffe-62d9-407f-9838-6f2da9da1c22" status: 409 len: 152 microversion: 2.1 time: 0.103740 Aug 24 11:31:08.382040 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 357/712] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:31:08 2022] DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments/4e5d7ffe-62d9-407f-9838-6f2da9da1c22 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:31:08.387644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:08.388175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:08.394417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.394901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.395334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.396062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.396513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.396935 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.448104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:08.448725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:08.451353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:08.457753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.458244 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.458681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.459386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.459842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.460268 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.474106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19962727-dab9-41eb-a1b2-97d9b4e5a13b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "POST /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/action" status: 202 len: 0 microversion: 2.1 time: 0.090068 Aug 24 11:31:08.474741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 356/713] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:08 2022] POST /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:08.482303 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:08.482999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:08.489782 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.490267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.490701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.491393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.491843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.492273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.604357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:08.613288 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:08.614795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:08.615908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-11cf0662-1d9b-4060-ab63-a9f3d4a8fab0 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1407 microversion: 2.20 time: 0.171815 Aug 24 11:31:08.616465 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 358/714] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:08 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:31:08.621041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:08.621668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:08.637796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.638697 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.639445 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.640696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:08.641545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:08.642427 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:08.655532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:08.664157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5d4b06d-ee28-4bb7-a34b-4f6d66288ca4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1676 microversion: 2.1 time: 0.185765 Aug 24 11:31:08.665056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 357/715] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:08 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:08.800384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:08.811596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5de5bb2c-8c17-4675-ab35-226a05e4070c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.194031 Aug 24 11:31:08.813606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 359/716] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:08 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:08.997367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:08.997909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:09.006601 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.007093 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.007537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.008243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.008693 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.009217 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.074181 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:09.082169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-171fac54-9992-4580-a256-38446a7037ed tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1310 microversion: 2.1 time: 0.088692 Aug 24 11:31:09.082727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 358/717] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:08 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:09.644964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:09.646109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:09.656759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.657483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.658629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.659721 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.660915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.660915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.688429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:09.689601 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:09.700966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.710509 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.711655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.712644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.713375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.715126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.914263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:09.926647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:09.933624 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:09.935852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cebf3fc2-bf83-45b8-be29-5efedc4cb822 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1599 microversion: 2.20 time: 0.299940 Aug 24 11:31:09.939632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 360/718] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:09 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1599 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:09.951638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:09.952407 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:09.978284 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.978849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.979297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:09.980040 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:09.980501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:09.980929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.090116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:10.113372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-584ec8ae-b7c8-4416-afe4-e4af5783b60e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1653 microversion: 2.1 time: 0.428475 Aug 24 11:31:10.115210 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 359/719] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:09 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1653 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:10.124997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:10.126589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:10.137077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.137957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.138640 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.139572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.140251 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.140891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.146597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:10.250292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:10.266548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cce84366-b3fa-416f-81fe-ee01432b6879 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.325158 Aug 24 11:31:10.271124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 361/720] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:09 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:10.281341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:10.284259 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:10.303408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.304278 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.304937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.305944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.309872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.310531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.327451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1febd24-86d5-4841-82c6-6ed937498447 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.210551 Aug 24 11:31:10.328299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 360/721] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Aug 24 11:31:10 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:31:10.334019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f840f90-9bc8-45b1-95d1-1ba2ce6b43c9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:10.348993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f840f90-9bc8-45b1-95d1-1ba2ce6b43c9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.351909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f840f90-9bc8-45b1-95d1-1ba2ce6b43c9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.352752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f840f90-9bc8-45b1-95d1-1ba2ce6b43c9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.354986 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:10.389670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f840f90-9bc8-45b1-95d1-1ba2ce6b43c9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Going to try to start instance {{(pid=120720) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:31:10.462761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f840f90-9bc8-45b1-95d1-1ba2ce6b43c9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action" status: 202 len: 0 microversion: 2.1 time: 0.131702 Aug 24 11:31:10.471024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 361/722] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:10 2022] POST /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:10.477299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:10.479261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:10.492597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.492928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.493436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.494208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:10.494627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:10.495056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:10.702245 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:10.711728 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-397300a4-723b-425f-b6cd-b1f9d9d66cd8 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.239270 Aug 24 11:31:10.721450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 362/723] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:10 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:11.290622 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:11.302172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:11.309703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:11.310552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:11.311240 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:11.312190 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:11.312713 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:11.313233 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:11.383509 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:11.415948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15790e3a-0984-42d2-a3d3-be880a3c601b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 1.143214 Aug 24 11:31:11.416768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 362/724] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:10 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:11.517435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:11.535557 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db2e470f-eec7-48db-8a11-42922c5a5e46 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.249502 Aug 24 11:31:11.549409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 363/725] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:11 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:11.736589 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:11.737161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:11.744181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:11.744757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:11.745348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:11.746123 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:11.746645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:11.747134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:11.982408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:11.995595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3642307b-1ec4-48eb-9588-b87f76f55334 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.263572 Aug 24 11:31:12.002004 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 363/726] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:11 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:12.317396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c67e026a-26e9-4d6b-a2d1-d09ecc28fd42 req-0fb30b40-ea82-4e77-98b2-f1a4b6557092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:12.330416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c67e026a-26e9-4d6b-a2d1-d09ecc28fd42 req-0fb30b40-ea82-4e77-98b2-f1a4b6557092 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:12.331063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c67e026a-26e9-4d6b-a2d1-d09ecc28fd42 req-0fb30b40-ea82-4e77-98b2-f1a4b6557092 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:12.331710 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c67e026a-26e9-4d6b-a2d1-d09ecc28fd42 req-0fb30b40-ea82-4e77-98b2-f1a4b6557092 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:12.345929 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c67e026a-26e9-4d6b-a2d1-d09ecc28fd42 req-0fb30b40-ea82-4e77-98b2-f1a4b6557092 service nova] Creating event network-changed:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:31:12.351524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c67e026a-26e9-4d6b-a2d1-d09ecc28fd42 req-0fb30b40-ea82-4e77-98b2-f1a4b6557092 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038500 Aug 24 11:31:12.352285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 364/727] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:12.441314 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:12.441960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:12.454969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:12.455808 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:12.456349 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:12.457344 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:12.457906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:12.458426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:12.559254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:12.560443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:12.567426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:12.568238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:12.568398 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:12.569072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:12.569606 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:12.570038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:12.698097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:12.707117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1480bcc-ab74-41c5-9555-357c45eff921 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.272179 Aug 24 11:31:12.721341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 364/728] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:12 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:12.759692 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:12.775381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb3fc9d6-c582-4ba1-a419-3a6070643c00 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.220418 Aug 24 11:31:12.776285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 365/729] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:12 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:13.019554 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:13.020402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:13.027397 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:13.028147 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:13.028735 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:13.029681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:13.030291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:13.030875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:13.175374 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:13.184661 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4b38913f-5dd3-4699-82bb-3dc36ebac89d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.169977 Aug 24 11:31:13.185497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 365/730] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:13 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:13.728046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:13.728595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:13.735016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:13.736189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:13.736797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:13.737531 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:13.737985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:13.738413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:13.802780 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:13.803452 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:13.810597 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:13.811086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:13.811673 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:13.812354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:13.812825 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:13.813269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:13.878794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:13.887987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36eb5705-5514-4fc4-92b6-abe04ebd4202 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.163835 Aug 24 11:31:13.888576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 366/731] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:13 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:13.968592 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:13.977998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4a253ad4-1db1-4bc9-8c0e-a4348b8b79b9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.180036 Aug 24 11:31:13.978634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 366/732] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:13 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:14.207356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:14.208331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:14.214705 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:14.215189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:14.215733 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:14.216506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:14.216956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:14.217607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:14.365723 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:14.373359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-06ad865e-1648-4ed8-be4a-5ece2d13b20a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.170442 Aug 24 11:31:14.373923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 367/733] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:14 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:14.910734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:14.911348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:14.918079 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:14.918563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:14.918997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:14.919690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:14.920142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:14.920562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:14.999587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:15.000300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:15.008005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:15.008492 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:15.008925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:15.009651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:15.010349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:15.010987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:15.074924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:15.083297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ce8df7d8-6a5d-4e08-84a0-aa029da4a8b3 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.177791 Aug 24 11:31:15.083876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 367/734] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:14 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:15.164539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:15.172952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05a32d48-cb65-46d4-95e2-30bb6436324e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.177275 Aug 24 11:31:15.174080 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 368/735] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:14 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:15.396027 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:15.396639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:15.402857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:15.403347 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:15.403930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:15.404660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:15.405108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:15.405553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:15.539970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:15.547931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-115c7b10-698d-4144-ad79-52f6979849da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.156664 Aug 24 11:31:15.561231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 368/736] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:15 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:16.106146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:16.106768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:16.109656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:16.116766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.117278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.117711 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.118413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.118862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.119286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.197157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:16.198062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:16.210480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.210976 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.211440 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.212148 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.212604 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.213029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.268442 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:16.277253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c9df8e7-e24b-478c-bfc7-6277e1e0cf71 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.175823 Aug 24 11:31:16.277819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 369/737] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:16 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:16.360001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:16.373422 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b8d84b06-e9e8-4992-bda2-1a1510826a65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.180593 Aug 24 11:31:16.377373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 369/738] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:16 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:16.566890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:16.567343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:16.573962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.574446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.574912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.575665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.576128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.580058 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.585814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:16.586520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:16.593073 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.593841 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.594354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.595141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:16.596235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:16.596736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:16.604625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ebdd968-d874-4794-b442-bfa548dd1423 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/ips" status: 200 len: 150 microversion: 2.1 time: 0.043196 Aug 24 11:31:16.605461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 370/739] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:31:16 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:16.705852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:16.751564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:16.765579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b0632336-eed8-4870-9118-da3ed0033f9d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.183220 Aug 24 11:31:16.766638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 370/740] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:16 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:17.299218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:17.300552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:17.308078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:17.308552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:17.309024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:17.310658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:17.310658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:17.314932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:17.411439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:17.412259 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:17.418017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:17.421679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:17.422452 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:17.423111 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:17.425771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:17.427811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:17.428552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:17.484035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:17.493770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a370dc59-737f-4a1d-bd98-7f4ecee0c4bb tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.198805 Aug 24 11:31:17.494727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 371/741] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:17 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:17.617795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:17.626695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-50919e14-68fb-400a-bdd4-9748bd90acdb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.222136 Aug 24 11:31:17.628161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 371/742] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:17 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:17.788414 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:17.789020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:17.795344 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:17.795825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:17.796252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:17.796951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:17.797419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:17.797840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:17.951009 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:17.960331 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-19b11600-df6c-419c-b4ad-4383484410b0 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.175726 Aug 24 11:31:17.966264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 372/743] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:17 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:18.013651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb444379-6fc2-458c-8281-a405cbbaa198"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:18.016100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:18.023024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.023527 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.023964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.024683 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.025137 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.025617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.514656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:18.515252 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:18.522541 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.523030 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.523617 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.524178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.524639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.525045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.675685 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:18.683652 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df39778a-16af-4ee7-bfa8-2cdc0a4a739c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.172975 Aug 24 11:31:18.684234 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 373/744] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:18 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:18.690142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:18.690963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:18.692997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:18.705752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.706404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.706678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.707561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.707838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.708767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.865597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:18.875287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5f22cf1-e366-43e4-afe0-4e468881d70b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.188996 Aug 24 11:31:18.875287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 374/745] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:18 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:18.988733 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:18.989381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:18.995492 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.995985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.996424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:18.997413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:18.997847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:18.998270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:19.165078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:19.173220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5948c9e1-961d-42df-a4f7-5b9d6ddb53e3 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.189240 Aug 24 11:31:19.174407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 375/746] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:18 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:19.704576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:19.705903 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:19.712444 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:19.712921 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:19.713394 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:19.714086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:19.714532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:19.714947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:19.849344 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:19.856909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41d82360-df76-4cb7-adac-a50bc78a3c2f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.156226 Aug 24 11:31:19.857514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 376/747] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:19 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:19.900371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:19.900973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:19.907418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:19.907931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:19.908354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:19.909155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:19.909629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:19.910081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:19.914755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:20.044242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:20.053042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98f1e242-7e74-4649-b55f-91c5c608ccfc tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.156576 Aug 24 11:31:20.053634 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 377/748] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:19 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:20.195312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:20.195928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:20.201803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:20.202284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:20.202717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:20.203425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:20.203878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:20.204330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:20.530119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:20.538784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28bf26cf-109a-456c-8cae-23f3209c8cc4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.347225 Aug 24 11:31:20.539600 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 378/749] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:20 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:20.878378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:20.879874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:20.885932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:20.886413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:20.886844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:20.887555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:20.888002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:20.888416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.027183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:21.035790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0274201f-bd4d-4d14-a346-3642c52c9bba tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.161836 Aug 24 11:31:21.036514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 379/750] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:20 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:21.047903 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-380a00ea-ca26-47b2-9ef4-9b9691f06495 req-bf667f6b-1e07-46c0-a00c-99321f1021ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:21.057270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-380a00ea-ca26-47b2-9ef4-9b9691f06495 req-bf667f6b-1e07-46c0-a00c-99321f1021ff service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.057742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-380a00ea-ca26-47b2-9ef4-9b9691f06495 req-bf667f6b-1e07-46c0-a00c-99321f1021ff service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.058165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-380a00ea-ca26-47b2-9ef4-9b9691f06495 req-bf667f6b-1e07-46c0-a00c-99321f1021ff service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.070107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-380a00ea-ca26-47b2-9ef4-9b9691f06495 req-bf667f6b-1e07-46c0-a00c-99321f1021ff service nova] Creating event network-changed:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:31:21.075130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-380a00ea-ca26-47b2-9ef4-9b9691f06495 req-bf667f6b-1e07-46c0-a00c-99321f1021ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Aug 24 11:31:21.075864 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 380/751] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:21.080794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:21.081514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:21.087470 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.087947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.088373 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.089065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.089537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.089954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.218964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:21.227719 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a0b7c51c-9857-4c02-9a7d-ac510b37c6b1 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.150759 Aug 24 11:31:21.228310 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 381/752] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:21 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:21.564329 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:21.565044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:21.570934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.571447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.571892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.572563 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.573015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.573459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.700778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:21.709220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-842414dc-fc0d-4ca6-b978-1ae2f9359acf tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.148814 Aug 24 11:31:21.709785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 382/753] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:21 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:22.056434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:22.057177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:22.063885 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:22.064897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:22.065402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.066094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:22.066540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:22.066959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.198716 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:22.207824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e012e74b-3865-48bb-9876-09b946bfd80c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.155124 Aug 24 11:31:22.214548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 383/754] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:22 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:22.255464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:22.255872 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:22.278440 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:22.279289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:22.279939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.280877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:22.281392 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:22.281808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.442353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:22.450858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-713740ad-1aa6-4382-8dee-a555ba1b76df tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1724 microversion: 2.1 time: 0.202759 Aug 24 11:31:22.451522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 384/755] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:22 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:22.512882 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cc7e9d18-2e01-41b9-8933-9f4afed55ac8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.503381 Aug 24 11:31:22.513528 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 372/756] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:31:18 2022] POST /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments => generated 194 bytes in 4505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:22.730717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:22.731359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:22.737704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:22.738187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:22.738680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.739315 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:22.739769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:22.740220 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.898494 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:22.906273 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fe963b9-4659-4bbf-a5f7-fdab33e7c9c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.179411 Aug 24 11:31:22.906881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 385/757] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:22 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:23.233145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:23.234003 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:23.242458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.243053 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.243558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.244551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.245065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.245753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.475418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:23.476623 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:23.484076 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.484630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.485064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.485816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.486866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.487288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.516460 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:23.524501 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-92a64ef1-f6d3-4af0-977c-357148b0b41f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.295492 Aug 24 11:31:23.525065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 373/758] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:23 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:23.723425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:23.732314 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e1ab43d2-4ca3-4133-9a8a-0e488f2db25c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1730 microversion: 2.1 time: 0.262062 Aug 24 11:31:23.733263 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 386/759] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:23 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:23.754711 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:23.755275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:23.761549 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.762042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.762722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.763546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.764011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.764437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.927542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dbd8d263-c023-42fd-bc0b-8a6b71e04548 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178363 Aug 24 11:31:23.927759 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:23.928499 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 374/760] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:31:23 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:23.928627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:23.934794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.935277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.935711 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:23.936409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:23.936854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:23.937369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:24.162543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:24.175877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed677c9d-c0a3-412f-a248-d44598c69087 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1662 microversion: 2.1 time: 0.251898 Aug 24 11:31:24.191821 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 387/761] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:23 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1662 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:24.545619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:24.546260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:24.553006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:24.553538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:24.553981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:24.554694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:24.555168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:24.555617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:24.689930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:24.698554 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5bf2000e-8ba9-455d-98e1-cb64b517e84e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.156755 Aug 24 11:31:24.700098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 375/762] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:24 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:25.163113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4c9262fb-3280-4003-88c2-d76f84dafd34 req-5b295f87-2ebe-430b-a527-771ae87bc4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c", "tag": "710de3ad-e4a8-487c-9709-7b5c8967061a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:25.175552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c9262fb-3280-4003-88c2-d76f84dafd34 req-5b295f87-2ebe-430b-a527-771ae87bc4e5 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:25.176031 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c9262fb-3280-4003-88c2-d76f84dafd34 req-5b295f87-2ebe-430b-a527-771ae87bc4e5 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:25.176460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4c9262fb-3280-4003-88c2-d76f84dafd34 req-5b295f87-2ebe-430b-a527-771ae87bc4e5 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:25.188676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4c9262fb-3280-4003-88c2-d76f84dafd34 req-5b295f87-2ebe-430b-a527-771ae87bc4e5 service nova] Creating event network-changed:710de3ad-e4a8-487c-9709-7b5c8967061a for instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c on hv-cinder-85427 Aug 24 11:31:25.194125 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4c9262fb-3280-4003-88c2-d76f84dafd34 req-5b295f87-2ebe-430b-a527-771ae87bc4e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034650 Aug 24 11:31:25.194813 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 388/763] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:25.200322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:25.200942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:25.207999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:25.208491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:25.209234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:25.209655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:25.210107 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:25.210556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:25.340498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:25.349258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55fdc533-b8dd-4bd9-ab3a-79f1dc792a35 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1666 microversion: 2.1 time: 0.152989 Aug 24 11:31:25.349839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 376/764] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:25 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:25.722142 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:25.723050 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:25.729938 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:25.730518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:25.731021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:25.731797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:25.732320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:25.732837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:25.876632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:25.884534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09466c34-7046-416c-a391-64be1ffa384f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.167461 Aug 24 11:31:25.885102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 389/765] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:25 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:26.906341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:26.907148 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:26.914494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:26.914729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:26.915628 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:26.915813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:26.916265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:26.916686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:27.178225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:27.186198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae74d029-c31f-4a21-ad14-25800c4d01c6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.283768 Aug 24 11:31:27.186755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 377/766] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:26 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:27.207998 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e11616f5-b03b-46c5-84dc-34c39b240198 req-b69497ec-ad37-4532-bb6d-473a3771c118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c", "tag": "710de3ad-e4a8-487c-9709-7b5c8967061a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:27.217729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e11616f5-b03b-46c5-84dc-34c39b240198 req-b69497ec-ad37-4532-bb6d-473a3771c118 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:27.218198 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e11616f5-b03b-46c5-84dc-34c39b240198 req-b69497ec-ad37-4532-bb6d-473a3771c118 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:27.218626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e11616f5-b03b-46c5-84dc-34c39b240198 req-b69497ec-ad37-4532-bb6d-473a3771c118 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:27.230385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e11616f5-b03b-46c5-84dc-34c39b240198 req-b69497ec-ad37-4532-bb6d-473a3771c118 service nova] Creating event network-changed:710de3ad-e4a8-487c-9709-7b5c8967061a for instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c on hv-cinder-85427 Aug 24 11:31:27.235128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e11616f5-b03b-46c5-84dc-34c39b240198 req-b69497ec-ad37-4532-bb6d-473a3771c118 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030759 Aug 24 11:31:27.236554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 390/767] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:28.207230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:28.207840 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:28.214285 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:28.214772 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:28.215201 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:28.215919 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:28.216370 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:28.216789 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:28.221035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:28.385802 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:28.394625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-19e5910e-2c34-4c6c-8e98-839ca123d9ae tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.191902 Aug 24 11:31:28.395303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 378/768] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:28 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:29.418149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:29.418874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:29.426289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:29.426769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:29.427197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:29.427887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:29.428333 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:29.428752 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:29.559066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:29.566666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f7b5818-1619-4f0b-9b0e-4ea9ecea074e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.152662 Aug 24 11:31:29.567228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 391/769] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:29 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:29.853981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-a5ec6462-5f8c-4c3a-9d71-33574e83238c req-b73babab-dff6-41c1-97c7-e45a5f778b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "name": "network-vif-plugged", "status": "completed", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:29.864771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a5ec6462-5f8c-4c3a-9d71-33574e83238c req-b73babab-dff6-41c1-97c7-e45a5f778b80 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:29.865275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a5ec6462-5f8c-4c3a-9d71-33574e83238c req-b73babab-dff6-41c1-97c7-e45a5f778b80 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:29.865930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-a5ec6462-5f8c-4c3a-9d71-33574e83238c req-b73babab-dff6-41c1-97c7-e45a5f778b80 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:29.878355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-a5ec6462-5f8c-4c3a-9d71-33574e83238c req-b73babab-dff6-41c1-97c7-e45a5f778b80 service nova] Creating event network-vif-plugged:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:31:29.883855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-a5ec6462-5f8c-4c3a-9d71-33574e83238c req-b73babab-dff6-41c1-97c7-e45a5f778b80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Aug 24 11:31:29.884459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 379/770] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:30.084913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb444379-6fc2-458c-8281-a405cbbaa198"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:30.087326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:30.093383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.093862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.094294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.094992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.095433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.095860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.184917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Invalid volume: volume bb444379-6fc2-458c-8281-a405cbbaa198 is already attached to instances: e4aa9e46-2498-48fe-a81e-c661818bf0b2 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments HTTP/1.1 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 74 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:31:30.186666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {"volumeAttachment": {"volumeId": "bb444379-6fc2-458c-8281-a405cbbaa198"}} Aug 24 11:31:30.188384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Invalid volume: volume bb444379-6fc2-458c-8281-a405cbbaa198 is already attached to instances: e4aa9e46-2498-48fe-a81e-c661818bf0b2 Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'server_id': 'e4aa9e46-2498-48fe-a81e-c661818bf0b2', 'body': {'volumeAttachment': {'volumeId': 'bb444379-6fc2-458c-8281-a405cbbaa198'}}} Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bb444379-6fc2-458c-8281-a405cbbaa198 is already attached to instances: e4aa9e46-2498-48fe-a81e-c661818bf0b2 Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:30.189493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bb444379-6fc2-458c-8281-a405cbbaa198 is already attached to instances: e4aa9e46-2498-48fe-a81e-c661818bf0b2 Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:30.191624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bb444379-6fc2-458c-8281-a405cbbaa198 is already attached to instances: e4aa9e46-2498-48fe-a81e-c661818bf0b2 Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 400 to user: Invalid volume: volume bb444379-6fc2-458c-8281-a405cbbaa198 is already attached to instances: e4aa9e46-2498-48fe-a81e-c661818bf0b2 {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd7f44ff-ce6b-4602-bc05-a47e2b491454 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108595 Aug 24 11:31:30.193183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 392/771] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:31:30 2022] POST /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:31:30.259333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:30.259925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:30.266564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.267065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.267510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.268935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.269764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.270204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.363708 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'services' on Instance uuid e4aa9e46-2498-48fe-a81e-c661818bf0b2 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:31:30.457111 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb4e0eb7-b22c-4fa4-a355-f4803ef9157c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments/bb444379-6fc2-458c-8281-a405cbbaa198" status: 202 len: 0 microversion: 2.1 time: 0.201789 Aug 24 11:31:30.457744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 380/772] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:31:30 2022] DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments/bb444379-6fc2-458c-8281-a405cbbaa198 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:31:30.468658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:30.472536 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:30.485042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.485695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.486454 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.488359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.489174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.489942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.522538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41e5b5c3-f6fd-4c05-a7c2-f0da24ede641 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060126 Aug 24 11:31:30.523103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 393/773] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:31:30 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:30.588791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:30.589540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:30.595728 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.596291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.596799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.597532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.597978 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.598402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.897236 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:30.905153 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6dc8a849-6ddc-4595-a076-356c7a212aa4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.320571 Aug 24 11:31:30.905786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 381/774] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:30 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:31.535299 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:31.537480 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:31.545050 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:31.545635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:31.546072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:31.546773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:31.547224 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:31.547648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:31.578773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2fc1d9b3-f652-46a9-9c24-5518ada273b1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Aug 24 11:31:31.579340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 394/775] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:31:31 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:31.926608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:31.927319 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:31.933548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:31.934029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:31.934458 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:31.935145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:31.935592 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:31.936017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.069893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:32.079195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-80a3c44b-71e3-4561-bca0-3e84bc0d3eb1 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1548 microversion: 2.1 time: 0.156939 Aug 24 11:31:32.079970 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 382/776] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:31 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:32.100339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:32.100942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:32.107148 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.107798 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.108318 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.109159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.109738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.110249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.247065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:32.250611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:32.257056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73019c00-fc22-476b-838f-9e55fa9b5d29 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1548 microversion: 2.1 time: 0.160449 Aug 24 11:31:32.257670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 395/777] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:32 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:32.277096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:32.281906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:32.282753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Searching by: {'deleted': False, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42'} {{(pid=120722) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 11:31:32.290093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.290572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.291003 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.291924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.292376 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.292798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.388545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.multi_cell_list [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120722) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 11:31:32.486474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acbd8eb0-bcc2-4e76-8043-b0a81e77598c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213047 Aug 24 11:31:32.487888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 383/778] 10.222.0.17 () {58 vars in 1125 bytes} [Wed Aug 24 11:31:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:32.499123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:32.499743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:32.506021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.506505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.506937 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.507626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.508256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.508682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.591911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:32.594176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:32.600903 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.601421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.602037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.602740 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.603187 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.603603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.637416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-077c4776-4df4-4f39-9450-262bc1576186 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049372 Aug 24 11:31:32.638008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 384/779] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:31:32 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:32.650191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:32.658173 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c333dd6d-dc63-45d0-9bbe-b1273676eeaa tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1548 microversion: 2.1 time: 0.162920 Aug 24 11:31:32.659320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 396/780] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:32 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:33.650250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:33.652417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:33.659080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.659834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.660283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.661139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.661641 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.662137 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.701623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5e07e2d6-c4c0-4533-8cb7-b3bb41762377 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055338 Aug 24 11:31:33.702224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 385/781] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:31:33 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:31:33.774946 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:33.775597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:33.783138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.783668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.784110 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.784837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.785325 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.785755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.814149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:31:33.902778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6428fc20-9aa7-4b98-9275-3d56b0df672f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 204 len: 0 microversion: 2.1 time: 0.131597 Aug 24 11:31:33.903410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 397/782] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:31:33 2022] DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:33.914095 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:33.914795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:33.920595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.921076 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.921537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.922224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.922670 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.923089 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:34.073334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:34.082112 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48dfde8a-ca49-4645-aca5-39ada3ca1aed tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1682 microversion: 2.1 time: 0.173976 Aug 24 11:31:34.082961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 386/783] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:33 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:34.283196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc13ef9c-c055-48d0-bb4d-31ef04be5843"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:34.286173 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:34.292246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:34.292741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:34.293173 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:34.293985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:34.294440 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:34.294865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.103412 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:35.104018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:35.110563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:35.111049 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:35.111478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.113091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:35.113544 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:35.113966 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.265615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:35.274331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e9eda818-c163-42dc-868c-ce6c8775a05c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1682 microversion: 2.1 time: 0.174684 Aug 24 11:31:35.274918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 387/784] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:35 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:35.676332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfffaea4-58eb-4be9-9086-635fc769c694 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.397346 Aug 24 11:31:35.677109 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 398/785] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:31:34 2022] POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments => generated 194 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:36.296249 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:36.296988 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:36.304763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:36.305269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:36.305702 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:36.306426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:36.306875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:36.307295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:36.603907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:36.612526 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3dc0577d-c3d4-489e-b7dc-44e600e4e8e3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1682 microversion: 2.1 time: 0.319659 Aug 24 11:31:36.613125 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 388/786] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:36 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1682 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:37.143838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f3c737b2-38d7-44a4-b278-93e24b167d91 req-10ebd015-c24f-4cf7-8d85-0f6c89660ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4aa9e46-2498-48fe-a81e-c661818bf0b2", "name": "network-vif-deleted", "tag": "8106f287-bc66-43ad-b14a-071c682d54cf"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:37.156207 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f3c737b2-38d7-44a4-b278-93e24b167d91 req-10ebd015-c24f-4cf7-8d85-0f6c89660ac7 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:37.157050 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f3c737b2-38d7-44a4-b278-93e24b167d91 req-10ebd015-c24f-4cf7-8d85-0f6c89660ac7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:37.157368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f3c737b2-38d7-44a4-b278-93e24b167d91 req-10ebd015-c24f-4cf7-8d85-0f6c89660ac7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.171405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f3c737b2-38d7-44a4-b278-93e24b167d91 req-10ebd015-c24f-4cf7-8d85-0f6c89660ac7 service nova] Creating event network-vif-deleted:8106f287-bc66-43ad-b14a-071c682d54cf for instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 on hv-cinder-85427 Aug 24 11:31:37.178847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f3c737b2-38d7-44a4-b278-93e24b167d91 req-10ebd015-c24f-4cf7-8d85-0f6c89660ac7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039816 Aug 24 11:31:37.179814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 399/787] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:37.634426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:37.635335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:37.642875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:37.643382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:37.644064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.644786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:37.645279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:37.645684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.686484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:37.687439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:37.687953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.688895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid e4aa9e46-2498-48fe-a81e-c661818bf0b2 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:31:37.745024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:37.755669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84be3df0-3184-4280-b831-a2fc02b9cfbc tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 200 len: 1331 microversion: 2.1 time: 0.125035 Aug 24 11:31:37.756710 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 389/788] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:37 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:38.777548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.778246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:38.785917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:38.786431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:38.786867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:38.787659 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:38.788025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:38.788446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:38.804446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 HTTP/1.1 Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:31:38.806101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:31:38.807630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e4aa9e46-2498-48fe-a81e-c661818bf0b2'} Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:38.808486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:31:38.810065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:31:38.811532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:38.811532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f89883b4-f4fa-455c-bb4d-8d8629c15799 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 404 len: 111 microversion: 2.1 time: 0.034363 Aug 24 11:31:38.811532 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 400/789] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:31:38.818349 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bc860bbe-e5eb-4832-8616-2ced5e4ccec5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '.version_select at 0x7f5ba4687ca0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.825177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=66 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:38.839033 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bc860bbe-e5eb-4832-8616-2ced5e4ccec5 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803678322" status: 202 len: 0 microversion: 2.1 time: 0.026033 Aug 24 11:31:38.839597 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 390/790] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 11:31:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803678322 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:39.489393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ad46dcc6-3626-4d0d-a70f-b518b51c3bd8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: .version_select at 0x7f5ba90175e0>, body: {"keypair": {"name": "tempest-keypair-894410485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBVWHl2I3KBqYMaACgngY2R3WXn/+kqD2zMVXHiyMPAjw8sQneDgFrgU31+1YTvq27Y5wVVG5gG9rqwWZsBuDWwe7cxCWgfDxBdHbxZ8Z6GASHLQjfulwizxKqIkOKIaQ=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:39.505290 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-ad46dcc6-3626-4d0d-a70f-b518b51c3bd8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:39.508970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-ad46dcc6-3626-4d0d-a70f-b518b51c3bd8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:39.532455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ad46dcc6-3626-4d0d-a70f-b518b51c3bd8 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047250 Aug 24 11:31:39.533031 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 401/791] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:31:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:40.789581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1211145044", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f827975f-fb9d-4fba-ac33-57f23df4fae0"}], "security_groups": [{"name": "tempest-securitygroup--778774055"}], "key_name": "tempest-keypair-894410485", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:40.901413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] validate_networks() for [('f827975f-fb9d-4fba-ac33-57f23df4fae0', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:31:41.361448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:31:41.362541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:31:41.363029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:31:41.363445 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:31:41.363865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:31:41.372671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:41.373153 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:41.373617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:41.374348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:41.374804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:41.375238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:41.398366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:31:41.404459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Getting quotas for user 478a5bf7e1fe4a3397fad4b84a6d2e1d and project 2e2e1c7bfe2142b6a1453b4f73c08d81. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:31:41.420905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:31:41.423240 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:31:41.470993 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4145fc5b-9e44-4a12-8e08-476f4346cfb7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.687801 Aug 24 11:31:41.471631 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 391/792] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:31:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:31:41.482316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f175ca0-4c86-43b5-a294-98aa9dd3b310 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:41.482930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f175ca0-4c86-43b5-a294-98aa9dd3b310 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:41.540193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f175ca0-4c86-43b5-a294-98aa9dd3b310 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:41.547313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f175ca0-4c86-43b5-a294-98aa9dd3b310 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1241 microversion: 2.1 time: 0.068791 Aug 24 11:31:41.547865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 402/793] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:41 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:42.569337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:42.569951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:42.576169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:42.576759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:42.577225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:42.577918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:42.578372 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:42.578795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:42.640620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:42.648414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6fbb49b7-e892-46e3-b590-d69de5dcaa9b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1237 microversion: 2.1 time: 0.084358 Aug 24 11:31:42.648980 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 392/794] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:42 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:43.311910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:43.312515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:43.319417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:43.319895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:43.320319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:43.321344 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:43.321796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:43.322216 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:43.458279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:43.466673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dcb1ac17-74c1-4e8a-b203-3c31d7a2c96a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1594 microversion: 2.1 time: 0.158830 Aug 24 11:31:43.467324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 403/795] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:43 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:43.668387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:43.669591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:43.678013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:43.678766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:43.679298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:43.680032 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:43.680435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:43.680869 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:43.763666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:43.775388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8434edd4-7ba0-46d3-90e7-09b0d764be20 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1299 microversion: 2.1 time: 0.110573 Aug 24 11:31:43.776749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 393/796] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:43 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:44.799762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:44.800575 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:44.808027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.808531 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.809137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.809886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.810478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.811101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:45.082990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:45.091743 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffa970e2-2b48-4c3a-bd25-8c7abf1338bf tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.297928 Aug 24 11:31:45.093066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 404/797] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:44 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:45.397182 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c2cd46f5-afdf-4a81-bf88-d7c35bc8b45e req-6b95958c-faea-45a3-a816-e9dee184f257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7089dba4-3339-49d8-8261-f5cf3be39f41", "tag": "f68b548e-d366-4cb9-82eb-239e73dbc8ee"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:45.407057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-434cbe82-aead-48ce-9197-03e0ff935260 req-48a7878b-1e56-4bd6-b745-5ed083b15318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:45.425297 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-434cbe82-aead-48ce-9197-03e0ff935260 req-48a7878b-1e56-4bd6-b745-5ed083b15318 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:45.425701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c2cd46f5-afdf-4a81-bf88-d7c35bc8b45e req-6b95958c-faea-45a3-a816-e9dee184f257 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:45.426291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c2cd46f5-afdf-4a81-bf88-d7c35bc8b45e req-6b95958c-faea-45a3-a816-e9dee184f257 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:45.426820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c2cd46f5-afdf-4a81-bf88-d7c35bc8b45e req-6b95958c-faea-45a3-a816-e9dee184f257 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:45.429457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-434cbe82-aead-48ce-9197-03e0ff935260 req-48a7878b-1e56-4bd6-b745-5ed083b15318 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:45.430219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-434cbe82-aead-48ce-9197-03e0ff935260 req-48a7878b-1e56-4bd6-b745-5ed083b15318 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:45.449033 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-434cbe82-aead-48ce-9197-03e0ff935260 req-48a7878b-1e56-4bd6-b745-5ed083b15318 service nova] Creating event network-changed:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:31:45.451133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c2cd46f5-afdf-4a81-bf88-d7c35bc8b45e req-6b95958c-faea-45a3-a816-e9dee184f257 service nova] Creating event network-changed:f68b548e-d366-4cb9-82eb-239e73dbc8ee for instance 7089dba4-3339-49d8-8261-f5cf3be39f41 on hv-cinder-85427 Aug 24 11:31:45.457378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c2cd46f5-afdf-4a81-bf88-d7c35bc8b45e req-6b95958c-faea-45a3-a816-e9dee184f257 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173555 Aug 24 11:31:45.458842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 394/798] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:45.461777 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-434cbe82-aead-48ce-9197-03e0ff935260 req-48a7878b-1e56-4bd6-b745-5ed083b15318 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141006 Aug 24 11:31:45.462364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 405/799] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:46.118190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:46.119682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:46.131210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.132172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.132847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.134326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.135179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.135948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.606746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:46.618051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c2f21d2f-1c71-41dc-b079-e57bd40e1c46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.508121 Aug 24 11:31:46.631791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 395/800] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:46 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:46.931345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1326841264"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:46.931972 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:46.938139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.938622 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.939057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.940600 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.941283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.941714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.077185 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Adding security group 97221822-bffe-4100-81cc-13da4af319fe to port c5005117-2be1-4c59-8e00-4ae454277f0c Aug 24 11:31:47.460975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9877b40-62fc-4520-9f99-b438f0512622 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.534311 Aug 24 11:31:47.462007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 406/801] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:46 2022] POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:47.473298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:47.474404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:47.483794 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.484617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.485340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.486524 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.487672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.488478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.503049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e3ef41e5-ec1b-4ba3-95e1-fc5707efc4ec req-3b30c443-f79e-44bc-af5b-1fbf12d2ed5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:47.516218 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:47.527585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3ef41e5-ec1b-4ba3-95e1-fc5707efc4ec req-3b30c443-f79e-44bc-af5b-1fbf12d2ed5f service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.528193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3ef41e5-ec1b-4ba3-95e1-fc5707efc4ec req-3b30c443-f79e-44bc-af5b-1fbf12d2ed5f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.528709 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e3ef41e5-ec1b-4ba3-95e1-fc5707efc4ec req-3b30c443-f79e-44bc-af5b-1fbf12d2ed5f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.546574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e3ef41e5-ec1b-4ba3-95e1-fc5707efc4ec req-3b30c443-f79e-44bc-af5b-1fbf12d2ed5f service nova] Creating event network-changed:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:31:47.555162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e3ef41e5-ec1b-4ba3-95e1-fc5707efc4ec req-3b30c443-f79e-44bc-af5b-1fbf12d2ed5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064052 Aug 24 11:31:47.557446 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 407/802] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:47.640275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:47.642714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:47.648632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.649235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.649690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.650439 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.650895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.651324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.688868 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:47.707922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e68654e9-fcf6-48da-98d0-175ac3ea514b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1641 microversion: 2.1 time: 0.241142 Aug 24 11:31:47.708712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 396/803] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:47 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1641 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:47.828515 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:47.843336 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f4b55f1-cf2d-41fc-a60c-2b727ee0a293 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.207368 Aug 24 11:31:47.844181 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 408/804] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:47 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:48.866495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:48.867295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:48.875281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.875819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.876295 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:48.877273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.877745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.878168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:49.134674 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:49.145070 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2134afed-21fd-4fa0-bb9b-b1d20ec8c2c4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.282301 Aug 24 11:31:49.145759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 397/805] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:48 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:50.168368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:50.169368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:50.171540 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:50.179477 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:50.180433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:50.180433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:50.181114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:50.181589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:50.182026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:50.241159 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:50.241811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:50.248787 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:50.249347 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:50.249997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:50.250716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:50.251175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:50.251648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:50.280459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-02761591-c7da-4802-b377-d962237a93bd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/ips" status: 200 len: 152 microversion: 2.20 time: 0.107350 Aug 24 11:31:50.281024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 398/806] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Aug 24 11:31:50 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/ips => generated 152 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:31:50.343928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:50.357356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ecd91d2-e0a0-4b54-a260-f6a57a0868e4 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.192565 Aug 24 11:31:50.358671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 409/807] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:50 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:51.380099 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:51.380708 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:51.384232 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=4 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:51.388543 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:51.389035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:51.389503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:51.390207 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:51.390662 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:51.391088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:51.411015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:51.531128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:51.540867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1f81a4a7-4647-4143-b88b-c1653aa31a55 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.165642 Aug 24 11:31:51.541556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 399/808] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:51 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:52.033895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a14c8a08-b83f-45f3-bc6d-9acbd56cda56 req-452f3510-6b3a-4401-8987-8cc33c0c39e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7089dba4-3339-49d8-8261-f5cf3be39f41", "name": "network-vif-plugged", "status": "completed", "tag": "f68b548e-d366-4cb9-82eb-239e73dbc8ee"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:52.039905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:52.047898 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a14c8a08-b83f-45f3-bc6d-9acbd56cda56 req-452f3510-6b3a-4401-8987-8cc33c0c39e7 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.048384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a14c8a08-b83f-45f3-bc6d-9acbd56cda56 req-452f3510-6b3a-4401-8987-8cc33c0c39e7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.049474 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a14c8a08-b83f-45f3-bc6d-9acbd56cda56 req-452f3510-6b3a-4401-8987-8cc33c0c39e7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.061186 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a14c8a08-b83f-45f3-bc6d-9acbd56cda56 req-452f3510-6b3a-4401-8987-8cc33c0c39e7 service nova] Creating event network-vif-plugged:f68b548e-d366-4cb9-82eb-239e73dbc8ee for instance 7089dba4-3339-49d8-8261-f5cf3be39f41 on hv-cinder-85427 Aug 24 11:31:52.066570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a14c8a08-b83f-45f3-bc6d-9acbd56cda56 req-452f3510-6b3a-4401-8987-8cc33c0c39e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Aug 24 11:31:52.067177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 410/809] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:52.562445 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:52.563054 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:52.570277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.570883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.571349 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.579862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.580334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.580767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.713098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:52.720751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-879a2c58-4643-472a-8427-79ac0bc91c7f tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.162246 Aug 24 11:31:52.721565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 400/810] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:52 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:53.722620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:53.723239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:53.729805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.730286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.730810 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.731437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.731883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.732301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.741164 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:53.741798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:53.749992 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.750490 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.750972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.752279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.753056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.754211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.759233 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lazy-loading 'flavor' on Instance uuid 1eb47ea0-f421-4999-9a87-35ee20241fb2 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:31:53.918228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:53.927994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8d7d3c92-8c0c-495b-9a2e-81bbe56e22ff tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1366 microversion: 2.1 time: 0.190655 Aug 24 11:31:53.928570 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 401/811] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:53 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:53.950590 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f2dd28dc-3ee9-4c31-9d9a-3483066bce48 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/action" status: 202 len: 0 microversion: 2.20 time: 0.232364 Aug 24 11:31:53.951173 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 411/812] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 11:31:53 2022] POST /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:53.959254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:53.959866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:53.965936 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.966645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.967084 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.967782 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.968235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.968657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.103736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:54.112485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:54.114014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:54.115176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9a7b74af-1e00-4ca7-aa7a-128195ceb010 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.159745 Aug 24 11:31:54.115726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 402/813] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:53 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:54.951052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:54.951771 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:54.959077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:54.959558 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:54.959984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.960764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:54.961223 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:54.961667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.102216 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.110587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-239f17c5-9176-43b9-9ba2-211dd55d2094 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1556 microversion: 2.1 time: 0.164208 Aug 24 11:31:55.111526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 412/814] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:54 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:55.133531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:55.134232 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:55.139491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:55.140099 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:55.140370 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.140864 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.141340 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.142056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.143126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.143556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.147917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.148410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.148841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.149574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.150028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.150449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.154987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:55.229585 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b6aee67-3888-4f05-9eaa-b49e0a348f53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101758 Aug 24 11:31:55.230496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 403/815] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:31:55 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:31:55.294500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.303936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.305558 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.306775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-613e037c-04a3-43f3-8677-a258b7189fb4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.171389 Aug 24 11:31:55.307362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 413/816] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:55 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:56.332068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:56.333037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:56.339230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.339725 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.340171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.340895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.341385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.341820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.525655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9c412c01-5be5-4780-b172-c95eb1a480b7 req-21843011-b693-446f-8a08-6f4e0bc5bc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7089dba4-3339-49d8-8261-f5cf3be39f41", "tag": "f68b548e-d366-4cb9-82eb-239e73dbc8ee"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:56.539339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9c412c01-5be5-4780-b172-c95eb1a480b7 req-21843011-b693-446f-8a08-6f4e0bc5bc64 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.546252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:56.549767 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9c412c01-5be5-4780-b172-c95eb1a480b7 req-21843011-b693-446f-8a08-6f4e0bc5bc64 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.550222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9c412c01-5be5-4780-b172-c95eb1a480b7 req-21843011-b693-446f-8a08-6f4e0bc5bc64 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.560498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:56.562390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:56.562960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9c412c01-5be5-4780-b172-c95eb1a480b7 req-21843011-b693-446f-8a08-6f4e0bc5bc64 service nova] Creating event network-changed:f68b548e-d366-4cb9-82eb-239e73dbc8ee for instance 7089dba4-3339-49d8-8261-f5cf3be39f41 on hv-cinder-85427 Aug 24 11:31:56.563571 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4466cc95-1969-4d1d-a30a-572f2928e253 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.236871 Aug 24 11:31:56.564687 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 404/817] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:56 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:31:56.568958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9c412c01-5be5-4780-b172-c95eb1a480b7 req-21843011-b693-446f-8a08-6f4e0bc5bc64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046895 Aug 24 11:31:56.569706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 414/818] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:57.590818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:57.591347 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:57.599037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.599528 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.599972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.600676 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.601119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.601591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.749144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.757771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.759277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.760444 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aff449ef-edf2-446e-8561-119b6aafce0a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.173778 Aug 24 11:31:57.761137 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 405/819] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:57 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:58.784839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:58.785614 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:58.792140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.792616 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.793043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:58.793765 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.794208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.794624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:58.936196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:58.951106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:58.953702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:58.955505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c4c1317e-136c-4f3a-bcee-5c2c48297670 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.175211 Aug 24 11:31:58.956298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 415/820] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:58 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:31:59.988015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:59.988729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:59.995322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.995805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.996248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.996942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.997438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.997862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:00.131142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:00.139694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:00.141179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:00.142507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f0ce2cb-a6b9-4906-9dc3-8355bb56587d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.158772 Aug 24 11:32:00.143068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 406/821] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:31:59 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:01.166218 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:01.166856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:01.173281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:01.174382 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:01.174934 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:01.175901 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:01.176611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:01.177350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:01.315808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:01.324085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:01.325788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:01.326936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-57ed4646-e472-4774-877c-1a7d1deffcba tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.164709 Aug 24 11:32:01.327481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 416/822] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:01 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:02.352410 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:02.353036 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:02.360062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.360555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.361600 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.362314 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.362770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.363200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.495440 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:02.505056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:02.506720 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:02.507895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de2d8190-e9c1-4f95-96c6-0226fe6048c3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.159520 Aug 24 11:32:02.508455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 407/823] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:02 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:03.536903 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:03.537785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:03.544740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:03.545274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:03.545716 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:03.546428 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:03.546881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:03.547305 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:03.696848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:03.708288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:03.709814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:03.710985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2addc792-0848-472f-b539-7f25135dfc1f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.179009 Aug 24 11:32:03.711542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 417/824] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:03 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:04.734807 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:04.735392 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:04.742606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:04.743128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:04.743595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:04.744396 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:04.744907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:04.745414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:04.888544 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.897671 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.899309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:04.900603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a8bf5ef6-7384-48a2-97d9-11f7553f4f8b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.170181 Aug 24 11:32:04.901162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 408/825] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:04 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:05.923718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:05.924376 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:05.931633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.932165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.932543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:05.933268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:05.933862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:05.934172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.072191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.080556 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.082071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.083223 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82b3b9fc-f51b-4b5e-9403-312ea55b3eee tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.163701 Aug 24 11:32:06.083781 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 418/826] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:05 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:06.243335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:06.243881 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.249742 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.250221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.250649 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.251834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.252277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.252782 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.349696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lazy-loading 'services' on Instance uuid 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:06.428094 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-08b51de3-c81c-4433-b17b-dc074654c92b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments/4e5d7ffe-62d9-407f-9838-6f2da9da1c22" status: 202 len: 0 microversion: 2.1 time: 0.189323 Aug 24 11:32:06.428759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 409/827] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:32:06 2022] DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments/4e5d7ffe-62d9-407f-9838-6f2da9da1c22 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:32:06.437423 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:06.440291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.446511 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.447005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.447494 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.448321 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.448790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.449326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.489081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f6f0b47-9344-4706-b27d-2725b8117228 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055761 Aug 24 11:32:06.489720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 419/828] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:06 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:07.107322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.108103 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.115420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.115905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.116339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.117041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.117512 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.117936 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.264175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.275339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.276876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:07.278106 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d602183a-1eff-4e31-ae85-2a9262d1ffc6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.175532 Aug 24 11:32:07.278669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 410/829] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:07.502044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.504461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.510931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.511413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.511909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.512618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.513060 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.513510 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.548507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f16787bd-28ba-47f7-a51c-408a8f8b4fef tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050293 Aug 24 11:32:07.549098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 420/830] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:08.302203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.302805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.309141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.309655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.310086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.310777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.311223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.311636 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.403659 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.405974 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.412203 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.412793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.413286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.414020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.414522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.414952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.449385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10e69882-0244-4ebb-a9ad-77c872e9c8e7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049897 Aug 24 11:32:08.450219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 421/831] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:32:08.456540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.465026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.466555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.467722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-77e11f75-bff9-43e2-ac04-ea540e439e2a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.169578 Aug 24 11:32:08.468281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 411/832] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:08.513533 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.514268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.521377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.521864 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.522308 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.523026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.523476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.523897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.548844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:08.560057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.562359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.572093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.572581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.573017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.573759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.574212 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.574630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.610155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-444624de-3f0c-422b-8878-1ce858f364a9 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053978 Aug 24 11:32:08.611425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 412/833] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:32:08.654436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef88b13c-32a5-418c-a6fa-beddc72b32a1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 204 len: 0 microversion: 2.1 time: 0.144515 Aug 24 11:32:08.655249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 422/834] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:08 2022] DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:08.664169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.664775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.676681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.677862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.678265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.678973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.679441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.679844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.684395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:08.715782 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.716398 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.724822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.724822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.724822 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.725678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.726001 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.726481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.767623 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:08.833273 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.845914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b315c68d-cf62-418b-90f7-574276b9799e tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1672 microversion: 2.1 time: 0.185477 Aug 24 11:32:08.846503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 413/835] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:08.858518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ecb64373-dc6f-4f69-8cc9-46f35331e8eb tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 204 len: 0 microversion: 2.1 time: 0.146797 Aug 24 11:32:08.859120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 423/836] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:08 2022] DELETE /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:08.868301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:08.868952 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:08.870819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:08.877686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.878177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.878874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.879577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:08.880022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:08.880438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.030773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.038793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-efef450b-34eb-4ec8-9ef3-77550bd80543 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1690 microversion: 2.1 time: 0.174614 Aug 24 11:32:09.039360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 414/837] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:08 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:09.491690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.492479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.498712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.499197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.499630 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.500371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.500843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.501341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.637251 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.646249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.647753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.648916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-608647e2-dc59-4094-83ff-f83c337e4bed tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.161708 Aug 24 11:32:09.649514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 424/838] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:09.867591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.868204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.874711 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.875188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.875616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.876820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.877298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.877718 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.014615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.023354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d9998581-3c51-4b6c-88ba-868a44ec00de tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1672 microversion: 2.1 time: 0.159612 Aug 24 11:32:10.023928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 415/839] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.060898 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.061545 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.068153 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.068624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.069067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.069869 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.070334 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.070763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.213102 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.220746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a85d423-bf27-4fd6-b0fd-11afeebbe03e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1690 microversion: 2.1 time: 0.163738 Aug 24 11:32:10.221319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 425/840] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.675101 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.675636 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.682079 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.682578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.683017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.683723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.684182 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.684607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.833454 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.841658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.843169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.844329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-57ccc20c-a632-4be0-9623-93a3f862d302 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.174551 Aug 24 11:32:10.845522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 416/841] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:11.044426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.045034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.052698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.053235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.053665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.054364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.054811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.055227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.200663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.208350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8263f2e7-fa99-4a2e-bcfe-21fb664ff52a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1672 microversion: 2.1 time: 0.167851 Aug 24 11:32:11.208911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 426/842] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.242681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.243292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.251895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.252440 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.253018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.254020 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.254480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.254911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.389798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.397680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b54e19e4-8454-4923-978c-d7ef65900d1f tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1690 microversion: 2.1 time: 0.159040 Aug 24 11:32:11.398251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 417/843] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.867505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.868137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.874342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.874828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.875262 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.875952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.876514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.876905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.881328 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.017970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.027350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.029089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.030235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c91b0c8-88f6-4d19-9e33-9872dcd24c35 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.166684 Aug 24 11:32:12.031010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 427/844] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:12.229012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.229769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.237138 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.237665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.238103 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.238803 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.239254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.239685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.372195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.380863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3564ae12-7c42-4123-9e49-90b158c96dca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1672 microversion: 2.1 time: 0.155857 Aug 24 11:32:12.381487 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 418/845] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:12.419406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.420028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.426956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.427442 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.427907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.428597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.429052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.429503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.578336 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.586485 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18155623-d289-412f-9d3f-4b0ca6f8e1ee tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1690 microversion: 2.1 time: 0.170914 Aug 24 11:32:12.587058 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 428/846] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.054074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.054688 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.060797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.061291 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.061736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.062430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.062884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.063306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.207235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.216321 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.217888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.219052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7be8d4d7-7ced-4815-a2b3-e4ca1cefe679 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.168965 Aug 24 11:32:13.219608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 419/847] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:13.402909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.403528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.410627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.411114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.411554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.412258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.412711 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.413137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.547406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.555182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0700c040-4e40-4924-9bf0-ca50380dd865 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1672 microversion: 2.1 time: 0.156102 Aug 24 11:32:13.555741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 429/848] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:13.607545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.608204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.614776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.615294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.615736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.616434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.616883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.617343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.749409 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.758235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8f01b9c-5a98-4ff4-af44-d2f3921a7f2e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1690 microversion: 2.1 time: 0.154648 Aug 24 11:32:13.758811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 420/849] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.243676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f7d65fb3-57b2-412d-a9b8-57605875524e req-b6895b27-d098-4364-ae63-6e88140da32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "name": "network-vif-plugged", "status": "completed", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:14.243924 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.244513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.252531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.252925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.254936 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.255388 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7d65fb3-57b2-412d-a9b8-57605875524e req-b6895b27-d098-4364-ae63-6e88140da32f service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.255724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.257026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7d65fb3-57b2-412d-a9b8-57605875524e req-b6895b27-d098-4364-ae63-6e88140da32f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.257507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.257684 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7d65fb3-57b2-412d-a9b8-57605875524e req-b6895b27-d098-4364-ae63-6e88140da32f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.257788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.288188 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f7d65fb3-57b2-412d-a9b8-57605875524e req-b6895b27-d098-4364-ae63-6e88140da32f service nova] Creating event network-vif-plugged:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:32:14.297091 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f7d65fb3-57b2-412d-a9b8-57605875524e req-b6895b27-d098-4364-ae63-6e88140da32f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115393 Aug 24 11:32:14.297739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 430/850] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:14.405361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.415301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.416684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.417901 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd4213ab-c6f0-4c8b-bdb6-0bd0a18f8714 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.178207 Aug 24 11:32:14.418788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 421/851] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:14.578426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.579130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.586265 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.586754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.587194 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.587899 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.588356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.588787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.735450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.743276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44adb8b8-63a2-4949-a383-fc24f9851585 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1672 microversion: 2.1 time: 0.169103 Aug 24 11:32:14.743839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 431/852] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.779833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.780554 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.788615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.789459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.790188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.790910 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.791370 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.791803 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.144554 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.152552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a7ea627e-0bb2-402b-a0a0-f058191fa13e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1690 microversion: 2.1 time: 0.376644 Aug 24 11:32:15.153476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 422/853] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1690 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:15.443246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.443809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.451466 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.451950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.452377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.453084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.453571 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.453990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.604881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.616625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.618691 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.620161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-87b7e0d1-0ea9-4f28-9f4c-516089c5d960 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1745 microversion: 2.20 time: 0.181333 Aug 24 11:32:15.620723 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 432/854] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:15.764706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.765947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.773372 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.773873 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.774343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.775377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.776056 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.776493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.887930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.896124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6fd72663-4d39-4cb0-93e1-328c9e9d49c4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1605 microversion: 2.1 time: 0.135664 Aug 24 11:32:15.911113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 423/855] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1605 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.180360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.180962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.187015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.187493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.187920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.188627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.189066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.189519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.262551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.273772 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7f3af298-838d-4d9d-96f2-27c3e60b1a37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1622 microversion: 2.1 time: 0.097048 Aug 24 11:32:16.274270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 433/856] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1622 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.313850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-3132b0c3-a029-44bf-bae8-9a4e37325c1d req-4a9f45d6-f813-47b8-8eec-c11f6786e7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040f5a2c-3c12-4b35-bdc5-91a6d497c066", "name": "network-vif-unplugged", "status": "completed", "tag": "1e711a0a-b7e0-44d7-90b0-2f700cc174b8"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:16.324168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3132b0c3-a029-44bf-bae8-9a4e37325c1d req-4a9f45d6-f813-47b8-8eec-c11f6786e7ac service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.324824 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3132b0c3-a029-44bf-bae8-9a4e37325c1d req-4a9f45d6-f813-47b8-8eec-c11f6786e7ac service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.325498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-3132b0c3-a029-44bf-bae8-9a4e37325c1d req-4a9f45d6-f813-47b8-8eec-c11f6786e7ac service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.346665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-3132b0c3-a029-44bf-bae8-9a4e37325c1d req-4a9f45d6-f813-47b8-8eec-c11f6786e7ac service nova] Creating event network-vif-unplugged:1e711a0a-b7e0-44d7-90b0-2f700cc174b8 for instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 on hv-cinder-85427 Aug 24 11:32:16.353849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-3132b0c3-a029-44bf-bae8-9a4e37325c1d req-4a9f45d6-f813-47b8-8eec-c11f6786e7ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043791 Aug 24 11:32:16.358258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 424/857] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:16.629915 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d430021d-415e-41db-bad8-6a43043d38c9 req-83c172e7-45e0-49a3-944a-eff35f7f57c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040f5a2c-3c12-4b35-bdc5-91a6d497c066", "name": "network-vif-deleted", "tag": "1e711a0a-b7e0-44d7-90b0-2f700cc174b8"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:16.648761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.649611 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.662866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.669727 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.670830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.671774 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.675933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.676532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.682271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d430021d-415e-41db-bad8-6a43043d38c9 req-83c172e7-45e0-49a3-944a-eff35f7f57c8 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.682909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d430021d-415e-41db-bad8-6a43043d38c9 req-83c172e7-45e0-49a3-944a-eff35f7f57c8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.683431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d430021d-415e-41db-bad8-6a43043d38c9 req-83c172e7-45e0-49a3-944a-eff35f7f57c8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.708137 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d430021d-415e-41db-bad8-6a43043d38c9 req-83c172e7-45e0-49a3-944a-eff35f7f57c8 service nova] Creating event network-vif-deleted:1e711a0a-b7e0-44d7-90b0-2f700cc174b8 for instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 on hv-cinder-85427 Aug 24 11:32:16.728372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d430021d-415e-41db-bad8-6a43043d38c9 req-83c172e7-45e0-49a3-944a-eff35f7f57c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102751 Aug 24 11:32:16.732010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 434/858] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:16.911206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.920655 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.922294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.925928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.927503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.928715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3650d132-554c-4816-a5f1-a060db56fd0c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1745 microversion: 2.20 time: 0.284372 Aug 24 11:32:16.930967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.931741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.932397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.933395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.934068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.934427 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 425/859] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:16.934964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.981441 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.982144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.982686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.983871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lazy-loading 'fault' on Instance uuid 040f5a2c-3c12-4b35-bdc5-91a6d497c066 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:17.031865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.039943 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e70f7b6-b1ea-41c8-83dc-12c6eaa69029 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 200 len: 1328 microversion: 2.1 time: 0.125001 Aug 24 11:32:17.040616 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 435/860] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:17.296677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.298290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.305338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.305838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.306270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.307338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.307806 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.308231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.341377 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.341778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.342216 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.342665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lazy-loading 'fault' on Instance uuid 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:17.394893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.404086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8a2d8c28-9b7d-401a-b6bf-b88c56448c57 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 200 len: 1335 microversion: 2.1 time: 0.111825 Aug 24 11:32:17.417483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 426/861] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:17.956380 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.957364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.963989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.964779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.965405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.966279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.966907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.967486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.065525 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.066172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.075565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.076051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.076481 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.077282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.080283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.080707 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.100683 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] HTTP exception thrown: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Request method failure captured: Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 HTTP/1.1 Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgs2COeG8eXxQ9LVwww2KUiNzcELvu0BMj2Qkrx5DFQ9-pufhhTXgVDGd13VJlBwONMDmN5pUWMZiRY8QztI4bIYzyCayXchNXwvnKRhE6KJGWzSSvqIyG8RAqujg9qjIvKwrvfU3aysTLsyB9HjmLftB0iR3_JNrc18LZuZBofoK8o Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:32:18.102433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 91a426581a984225a97d7f4d60380aba Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:32:18.103902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '040f5a2c-3c12-4b35-bdc5-91a6d497c066'} Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:18.104734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:32:18.106039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.107155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Returning 404 to user: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:18.107155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f863c0ce-99ee-402b-ab4f-f5b3355d44e6 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 404 len: 111 microversion: 2.1 time: 0.045763 Aug 24 11:32:18.108130 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 427/862] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:32:18.115042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16a8ef15-9058-4424-b267-11e1ec08b00c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '.version_select at 0x7f5ba4687d30>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.135706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16a8ef15-9058-4424-b267-11e1ec08b00c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045578153" status: 202 len: 0 microversion: 2.1 time: 0.026369 Aug 24 11:32:18.136288 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 428/863] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 11:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045578153 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:18.143938 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.153118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.154859 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.156875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db81e892-1e0b-4ec9-b2dd-2b362e9fea40 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.205000 Aug 24 11:32:18.159071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 436/864] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:18.430127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.431007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.442832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.443614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.444243 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.445128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.445759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.446343 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.463715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] HTTP exception thrown: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c could not be found. Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Request method failure captured: Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c HTTP/1.1 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrhz4gfHQU5F4BnbUrdMt4WvJrVKE326M2yKdG7ug6Zhfb5tlFsGbS8RBWl0IB6CA6GP6gejXKiplrbCPi7U-5iqCSIS09L1d3J_GrtWlp4FenA1OQmHXvTDAxoPAyKHcvefMTruSghEIXli1ol3_s2nbKmvMYHvn18His6ubYUa08 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:32:18.465579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 6f7224ed18ba423084846da68a920f52 Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c could not be found. Aug 24 11:32:18.467181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c'} Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c could not be found. Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:18.468093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c could not be found. Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c could not be found. Aug 24 11:32:18.469602 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:18.472274 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Returning 404 to user: Instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:18.473322 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da861b69-3325-4bc5-812d-9c3aadaee643 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c" status: 404 len: 111 microversion: 2.1 time: 0.047505 Aug 24 11:32:18.474062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 429/865] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:32:18.485169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25d042b7-0e76-4477-a06a-a9098420df8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '.version_select at 0x7f5ba8fceca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.527159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25d042b7-0e76-4477-a06a-a9098420df8a tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699073349" status: 202 len: 0 microversion: 2.1 time: 0.047627 Aug 24 11:32:18.528396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 437/866] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 11:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699073349 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:18.754748 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-961d57eb-fb1c-4e0a-9ff7-0d85cad1165a req-be337b00-04f7-4247-9fb1-9dfcc5449b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c", "name": "network-vif-deleted", "tag": "710de3ad-e4a8-487c-9709-7b5c8967061a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:18.764557 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-961d57eb-fb1c-4e0a-9ff7-0d85cad1165a req-be337b00-04f7-4247-9fb1-9dfcc5449b93 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.765031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-961d57eb-fb1c-4e0a-9ff7-0d85cad1165a req-be337b00-04f7-4247-9fb1-9dfcc5449b93 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.765482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-961d57eb-fb1c-4e0a-9ff7-0d85cad1165a req-be337b00-04f7-4247-9fb1-9dfcc5449b93 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.777620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-961d57eb-fb1c-4e0a-9ff7-0d85cad1165a req-be337b00-04f7-4247-9fb1-9dfcc5449b93 service nova] Creating event network-vif-deleted:710de3ad-e4a8-487c-9709-7b5c8967061a for instance 4414049e-a7de-4ff8-bf4b-2fe0aecd7d7c on hv-cinder-85427 Aug 24 11:32:18.783836 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-961d57eb-fb1c-4e0a-9ff7-0d85cad1165a req-be337b00-04f7-4247-9fb1-9dfcc5449b93 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033974 Aug 24 11:32:18.784696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 430/867] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:19.081104 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30286ddc-82c2-4595-9f35-d49870e973e9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: .version_select at 0x7f5ba9001160>, body: {"keypair": {"name": "tempest-keypair-1921109006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYpblZcD9BagLyv4mtUwyQqUOfeHMzH5dY1p8bEJfkcHssI5HVf+50r2EBfFXo1llj+vyloC06Tw4kmqj6po7PQ+Vbe54vJyK4+NNmWYNNY/HWVyixvSXUKpEr1Cf5Yw=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:19.100355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-30286ddc-82c2-4595-9f35-d49870e973e9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:19.107276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-30286ddc-82c2-4595-9f35-d49870e973e9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for user 91a426581a984225a97d7f4d60380aba and project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:19.135837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30286ddc-82c2-4595-9f35-d49870e973e9 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059474 Aug 24 11:32:19.138909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 438/868] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:32:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:19.189540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.191555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.200996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.202529 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.203189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.205188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.207341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.208012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.446968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.457665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.459695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:19.461267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-99fd16e7-6bd8-442f-bd97-22a3cf1f2e64 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.278930 Aug 24 11:32:19.461836 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 431/869] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:19.960742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:19.963405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.978624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.979890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.980649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.981790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.982415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.983131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.081825 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fae2e76a-f633-41c7-adb6-b63cb42bb7b6 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.125344 Aug 24 11:32:20.083114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 439/870] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:19 2022] POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:20.099598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.102698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.117260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.117736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.118511 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.119339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.120155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.120863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.392070 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.402888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e4ca96d6-3704-4050-9220-28782f3cd64e tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1751 microversion: 2.1 time: 0.315028 Aug 24 11:32:20.416455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 432/871] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1751 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:20.486851 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.487819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.494138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:20.495953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.496782 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.497499 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.498409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.499232 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.499803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.810434 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.826290 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.828283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.842929 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32fbb1b4-a0dc-4069-b32b-e9941a2e367d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.362546 Aug 24 11:32:20.844170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 440/872] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:21.376290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-78726924", "imageRef": "d18cd0a4-97fe-4950-b390-ef074b43532a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f86f70a-fb12-4770-8c95-ad2a3c0607dd"}], "security_groups": [{"name": "tempest-securitygroup--1177685821"}], "key_name": "tempest-keypair-1921109006", "user_data": "}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:21.444097 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.445397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.453339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.454553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.455211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.456096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.458357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.458357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.530141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] validate_networks() for [('1f86f70a-fb12-4770-8c95-ad2a3c0607dd', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:32:21.871269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.880410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34823b8e-3f4e-4f70-a2c5-9fa62d30743f tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.440009 Aug 24 11:32:21.893711 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 441/873] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:21.900522 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.901395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.909154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.909902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.910492 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.911385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.911981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.912574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.118373 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.129117 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.130924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.132368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d1528864-1d9e-4c56-8ca5-53bb559698f4 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.237274 Aug 24 11:32:22.145271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 442/874] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:22.145271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.145271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.153962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.154453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.154883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.155578 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.157635 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.158827 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.192672 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:22.294237 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09048c0a-ef48-4d8b-8dfa-4c7bf6c30ba6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 204 len: 0 microversion: 2.1 time: 0.155879 Aug 24 11:32:22.295257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 443/875] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:22 2022] DELETE /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:22.304669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.305449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.311804 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.312464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.312900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.313856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.314507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.314940 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.321790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:22.337853 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:32:22.338607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:32:22.339329 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:32:22.340023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:32:22.340441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:32:22.352400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.353277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.353959 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.354857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.355421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.355955 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.365735 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:22.388373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:22.394603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Getting quotas for user 91a426581a984225a97d7f4d60380aba and project 33444243cd2042d2aa895c226fa3fc3b. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:22.417000 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:32:22.420010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18cd0a4-97fe-4950-b390-ef074b43532a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:32:22.488503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c426e4e0-7f08-4465-9e1a-66bb9bd40a32 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.117030 Aug 24 11:32:22.489612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 433/876] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:32:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:32:22.501015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c9e32a4e-b198-43d4-b97e-26abef544f39 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.501943 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c9e32a4e-b198-43d4-b97e-26abef544f39 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.502582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.512633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-755144d4-2ece-4337-80f1-e2a545d04e7c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1507 microversion: 2.1 time: 0.212483 Aug 24 11:32:22.514426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 444/877] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.581392 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c9e32a4e-b198-43d4-b97e-26abef544f39 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.588842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c9e32a4e-b198-43d4-b97e-26abef544f39 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1236 microversion: 2.1 time: 0.092235 Aug 24 11:32:22.602911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 434/878] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.906319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.907633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.918353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.919234 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.919873 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.920998 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.921717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.922369 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.095391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.103824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6987ecac-cd08-4942-88d5-d7476e6d7335 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.201884 Aug 24 11:32:23.104423 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 445/879] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:23.159141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.160043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.170328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.171324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.171773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.172736 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.173235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.173765 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.336483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.345496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.347430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.348794 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5cb55c3-c9ef-4dcc-bffd-98f758c549a3 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.194218 Aug 24 11:32:23.361301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 435/880] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:23.535236 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.535979 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.543359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.543858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.544438 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.545143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.545751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.546171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.610470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.612090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.638956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.639939 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.640614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.642195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.643088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.643762 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.746592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.760293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.771362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f0693231-eb24-4a73-865e-b4718d722319 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1507 microversion: 2.1 time: 0.240017 Aug 24 11:32:23.771944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 446/881] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:23.776447 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b6593615-d669-4773-8d81-f1520e8ce6c7 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1240 microversion: 2.1 time: 0.170147 Aug 24 11:32:23.777289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 436/882] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1240 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:24.127282 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.128997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.135170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.135887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.136414 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.137566 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.138079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.138564 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.308582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.317587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-abb54341-a669-42b7-a936-218b7ba6dd7b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.195084 Aug 24 11:32:24.318378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 447/883] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.373747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.374766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.381471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.382032 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.382467 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.383158 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.383609 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.384028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.650062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.660703 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.662658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.664035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d7689d47-bf58-4730-8167-1cf04039b8c5 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.294158 Aug 24 11:32:24.677502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 437/884] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:24.794138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.795395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.805796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.806957 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.808838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.809509 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.811072 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.812184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.812800 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.813823 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.827396 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.828166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.828839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.830284 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.830897 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.831786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.950000 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.972220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b19b488-ab87-4350-a818-f7c4ed0c039b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1296 microversion: 2.1 time: 0.174891 Aug 24 11:32:24.973780 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 438/885] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:25.065589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.090528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10e79408-6f53-47e4-99aa-4aee34d7fd89 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1507 microversion: 2.1 time: 0.302316 Aug 24 11:32:25.105883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 448/886] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:25.247737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-c4f95dc6-cca4-4b8d-ac9f-f0abdd48ea84 req-b8884723-f547-489f-8709-6c336a437c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fe0be5-3ba8-4676-85ab-9d684b791acc", "name": "network-vif-deleted", "tag": "0d08a08e-ebd6-4093-854e-61076478683a"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:25.264696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c4f95dc6-cca4-4b8d-ac9f-f0abdd48ea84 req-b8884723-f547-489f-8709-6c336a437c1e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.265227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c4f95dc6-cca4-4b8d-ac9f-f0abdd48ea84 req-b8884723-f547-489f-8709-6c336a437c1e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.267144 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-c4f95dc6-cca4-4b8d-ac9f-f0abdd48ea84 req-b8884723-f547-489f-8709-6c336a437c1e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.287536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-c4f95dc6-cca4-4b8d-ac9f-f0abdd48ea84 req-b8884723-f547-489f-8709-6c336a437c1e service nova] Creating event network-vif-deleted:0d08a08e-ebd6-4093-854e-61076478683a for instance d3fe0be5-3ba8-4676-85ab-9d684b791acc on hv-cinder-85427 Aug 24 11:32:25.293496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-c4f95dc6-cca4-4b8d-ac9f-f0abdd48ea84 req-b8884723-f547-489f-8709-6c336a437c1e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049734 Aug 24 11:32:25.294729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 439/887] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:25.342087 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.343228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.356253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.356844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.357396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.358243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.358826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.359337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.640543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.665751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48480b4b-5831-402b-88d2-2a65e5c63101 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.329972 Aug 24 11:32:25.693958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 449/888] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:25.695646 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.696417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.705038 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.713783 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.714551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.715496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.716171 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.716814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.982795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.995194 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.997068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.998616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e84c2b6-328f-4bed-bb68-69b91d5b1607 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.307414 Aug 24 11:32:25.998829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.999336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 440/889] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:26.001231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.011095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.011961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.012740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.016833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.017667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.018351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.099551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.114351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-272df4b4-bb24-40c9-a30c-e987c6c7467f tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1294 microversion: 2.1 time: 0.121775 Aug 24 11:32:26.115848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 450/890] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.115984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.116607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.139324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.143200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.143675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.145055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.145744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.146182 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.199730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.200231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.200672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.201133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lazy-loading 'fault' on Instance uuid d3fe0be5-3ba8-4676-85ab-9d684b791acc {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:26.271493 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.282463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-229fa80f-a35d-410b-b556-2fd77ced0b65 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 200 len: 1311 microversion: 2.1 time: 0.170192 Aug 24 11:32:26.292048 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 441/891] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.701164 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.701783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.713830 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.714364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.715213 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.716410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.716927 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.720293 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.929905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.941239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-49630fc4-f5da-45d7-83aa-df9b91d2de39 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.241834 Aug 24 11:32:26.941239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 451/892] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.024520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.025794 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.042285 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.042779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.043445 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.044348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.044984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.045632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.136402 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.137677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.145770 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.146528 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.147140 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.148168 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.148880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.149489 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.321319 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.325836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.336222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ed8ab97-0d3b-4f39-b376-2c2a4a0c809a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.203794 Aug 24 11:32:27.337432 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 452/893] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.342505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.343375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: d3fe0be5-3ba8-4676-85ab-9d684b791acc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.355270 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.356076 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.356658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.357607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.358343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.358961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.369889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.378917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] HTTP exception thrown: Instance d3fe0be5-3ba8-4676-85ab-9d684b791acc could not be found. Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Request method failure captured: Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc HTTP/1.1 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrhz4gfHQU5F4BnbUrdMt4WvJrVKE326M2yKdG7ug6Zhfb5tlFsGbS8RBWl0IB6CA6GP6gejXKiplrbCPi7U-5iqCSIS09L1d3J_GrtWlp4FenA1OQmHXvTDAxoPAyKHcvefMTruSghEIXli1ol3_s2nbKmvMYHvn18His6ubYUa08 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:32:27.380875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 6f7224ed18ba423084846da68a920f52 Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance d3fe0be5-3ba8-4676-85ab-9d684b791acc could not be found. Aug 24 11:32:27.382618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'd3fe0be5-3ba8-4676-85ab-9d684b791acc'} Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fe0be5-3ba8-4676-85ab-9d684b791acc could not be found. Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:27.383549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fe0be5-3ba8-4676-85ab-9d684b791acc could not be found. Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fe0be5-3ba8-4676-85ab-9d684b791acc could not be found. Aug 24 11:32:27.386243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:27.388715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.389783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Returning 404 to user: Instance d3fe0be5-3ba8-4676-85ab-9d684b791acc could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:27.390817 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f786c656-f789-4c63-8405-b0a4339ca13c tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc" status: 404 len: 111 microversion: 2.1 time: 0.052175 Aug 24 11:32:27.391600 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 453/894] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/d3fe0be5-3ba8-4676-85ab-9d684b791acc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:32:27.394862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c97ab084-ada4-4241-a344-6e8320f6b729 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.372052 Aug 24 11:32:27.397741 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 442/895] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:27.400350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.401060 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.414007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.414819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.415524 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.417116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.417762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.418343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.458377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:27.522180 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-cde757fb-14bf-49a8-b069-afa1af7e396d req-56fdc3b1-d6ad-4e8e-ac8d-e76962cc26c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7f5ac0-3211-4d69-bcec-99f90bab124c", "tag": "df280a3d-128e-49e9-95e6-48cbd65aff9d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:27.538173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cde757fb-14bf-49a8-b069-afa1af7e396d req-56fdc3b1-d6ad-4e8e-ac8d-e76962cc26c4 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.538724 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cde757fb-14bf-49a8-b069-afa1af7e396d req-56fdc3b1-d6ad-4e8e-ac8d-e76962cc26c4 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.539241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-cde757fb-14bf-49a8-b069-afa1af7e396d req-56fdc3b1-d6ad-4e8e-ac8d-e76962cc26c4 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.559816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-cde757fb-14bf-49a8-b069-afa1af7e396d req-56fdc3b1-d6ad-4e8e-ac8d-e76962cc26c4 service nova] Creating event network-changed:df280a3d-128e-49e9-95e6-48cbd65aff9d for instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c on hv-cinder-85427 Aug 24 11:32:27.566415 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-cde757fb-14bf-49a8-b069-afa1af7e396d req-56fdc3b1-d6ad-4e8e-ac8d-e76962cc26c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052981 Aug 24 11:32:27.567568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 443/896] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:27.596091 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1724ecc-9084-454e-aa79-7151aa499408 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "DELETE /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 204 len: 0 microversion: 2.1 time: 0.199513 Aug 24 11:32:27.597484 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 454/897] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:27 2022] DELETE /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:27.608017 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.609157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.619302 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.620088 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.620954 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.621902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.624548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.625226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.804617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.817505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-74156d39-1cda-424b-8372-b470c201b76e tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.215668 Aug 24 11:32:27.818459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 444/898] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.962559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.963961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.974212 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.974824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.975343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.976133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.976665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.977159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.161862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.173997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47629675-7aff-4c1a-a485-28f1becccf00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.215616 Aug 24 11:32:28.174593 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 455/899] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:28.364497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.365119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.373797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.374844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.375354 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.377852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.378798 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.379426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.418063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.418798 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.426754 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.427667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.428290 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.429163 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.429794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.430367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.579908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.591932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-daa920e7-83e5-4a5d-8c37-7ab83010bc98 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.231359 Aug 24 11:32:28.605268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.606046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 445/900] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:28.617703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.619311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:28.620585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41d4197e-5f5e-40a1-993c-1c0871934b5d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.206758 Aug 24 11:32:28.621256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 456/901] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:28.846140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.847039 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.856852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.857456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.857900 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.858612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.859067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.859489 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.036312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.044420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-16c156fc-d727-4d3b-a5bd-4ac17497639b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.205318 Aug 24 11:32:29.045008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 446/902] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.194459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.195087 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.197083 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.203098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.204246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.204819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.205547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.206001 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.206426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.347968 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.356514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80153fc5-2df0-4276-982a-1d69c7034cd7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.165918 Aug 24 11:32:29.357078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 457/903] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.614475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.615105 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.621746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.622237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.622676 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.623373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.623825 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.624300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.646261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.647012 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.660881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.661411 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.661840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.662629 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:29.663078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:29.663494 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:29.770178 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.779784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0cadb918-d000-485f-b3bf-ac4297e81142 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.169077 Aug 24 11:32:29.780515 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 447/904] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.813881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.822539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.824029 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.825187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-138291e2-329d-4014-a4a6-5fefa84fe444 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1740 microversion: 2.20 time: 0.185430 Aug 24 11:32:29.825773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 458/905] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:30.066478 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.067224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.074127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.074613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.075043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.075734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.076181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.076599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.254123 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.261870 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8114f6eb-7d0f-43fa-b361-d6f4c79fd6f8 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1521 microversion: 2.1 time: 0.199767 Aug 24 11:32:30.262430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 448/906] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.377911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.379589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.393123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.394089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.395571 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.396559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.397302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.398138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.671029 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.680944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:30.684577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4e3afd7-b10d-4193-8a04-8df0b997ed31 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.311216 Aug 24 11:32:30.689240 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 459/907] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.820091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.821389 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.831698 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.832641 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.833473 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.834741 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.835782 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.836574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.854924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.855667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.866598 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.869784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.870424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.871889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.872548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.873274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.085526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.096921 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.098482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.099745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e9f32c1-0404-4eee-869e-ab854406eaae tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1722 microversion: 2.20 time: 0.252762 Aug 24 11:32:31.100350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 460/908] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:31.180397 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.188200 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2946ec57-dd76-4c42-8e56-028f3e772071 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.386177 Aug 24 11:32:31.188759 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 449/909] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:31.284065 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.284829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.292570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.293079 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.293546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.294254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.294709 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.295246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.366882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.382171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-651c4f1c-c8e7-4fed-9c00-0fc1cfc0171b tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1479 microversion: 2.1 time: 0.102290 Aug 24 11:32:31.388889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 461/910] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1479 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:31.417389 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9ac0220b-9400-425b-9fbe-aeb4f1eab938 req-070f3975-2c71-4b6c-b7ef-2a2817cc3125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bc3b79-e078-405a-9d06-0a01d90b0dde", "name": "network-vif-deleted", "tag": "62e4296a-e8be-44f0-8599-a8e7b4d4ff36"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:31.427469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9ac0220b-9400-425b-9fbe-aeb4f1eab938 req-070f3975-2c71-4b6c-b7ef-2a2817cc3125 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.427938 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9ac0220b-9400-425b-9fbe-aeb4f1eab938 req-070f3975-2c71-4b6c-b7ef-2a2817cc3125 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.428360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9ac0220b-9400-425b-9fbe-aeb4f1eab938 req-070f3975-2c71-4b6c-b7ef-2a2817cc3125 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.440363 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9ac0220b-9400-425b-9fbe-aeb4f1eab938 req-070f3975-2c71-4b6c-b7ef-2a2817cc3125 service nova] Creating event network-vif-deleted:62e4296a-e8be-44f0-8599-a8e7b4d4ff36 for instance 91bc3b79-e078-405a-9d06-0a01d90b0dde on hv-cinder-85427 Aug 24 11:32:31.445330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9ac0220b-9400-425b-9fbe-aeb4f1eab938 req-070f3975-2c71-4b6c-b7ef-2a2817cc3125 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031901 Aug 24 11:32:31.445928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 450/911] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:31.706847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.707459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.714640 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.715123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.715551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.716254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.716701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.717120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.881594 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.889987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89d778d2-3303-4f5a-9ac2-38e2027297cc tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.187449 Aug 24 11:32:31.890563 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 462/912] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:32.125026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.126711 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.133133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.133660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.134099 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.134796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.135253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.135677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.207965 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.208680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.214864 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.215346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.215773 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.216469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.216919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.217549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.276271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.285634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.287179 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.288421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2d4ab456-5f18-4ba5-a83d-f979bc5d0722 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1722 microversion: 2.20 time: 0.168154 Aug 24 11:32:32.289002 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 451/913] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:32.369671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.383796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-091af6c8-8bca-47ff-a01a-d59a65581b73 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.179189 Aug 24 11:32:32.384851 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 463/914] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:32.403880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.404496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.407175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:32.407849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:32.413726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.414213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.414646 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.416010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.416010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.416247 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.488379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.496475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-daf8cc03-7611-4f95-983c-ef8b09f6bdde tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1479 microversion: 2.1 time: 0.096298 Aug 24 11:32:32.497379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 452/915] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1479 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:32.910991 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.912278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.920888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.921417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.921858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.923209 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.923631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.924074 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.082842 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.090983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d75e41fb-506e-4df3-b407-d818da67e1a4 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.183960 Aug 24 11:32:33.091537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 464/916] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:33.312307 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.313469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.315336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=8 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:33.321108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.321630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.322072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.322773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.323228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.323655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.327740 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:33.404971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.405603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.411755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.412391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.412844 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.413571 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.414027 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.414795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.453381 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.461834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.463399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.464559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6e80e2f1-b0c1-4bb9-b26b-e1324020702b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1722 microversion: 2.20 time: 0.156220 Aug 24 11:32:33.465114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 453/917] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:33.518669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.519397 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.525795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.526463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.526962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.527732 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.528268 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.528754 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.551205 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.558858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02efe48d-d5a3-41e8-906d-3710b35c8c86 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.157642 Aug 24 11:32:33.559427 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 465/918] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:33.590126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7224ed18ba423084846da68a920f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a049f6edc63419f8fc6895f3ee878f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.598303 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7b7c7076-ebac-447c-bfb2-62be92035d37 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 200 len: 1306 microversion: 2.1 time: 0.083633 Aug 24 11:32:33.598876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 454/919] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:34.112043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.112571 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.120807 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.121338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.121771 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.122473 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.122917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.123556 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.167775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d0452677-c65f-4092-8c20-057d8bc2978a req-86579340-fb63-4ccc-9465-66444f02d2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "name": "network-vif-unplugged", "status": "completed", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:34.183134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0452677-c65f-4092-8c20-057d8bc2978a req-86579340-fb63-4ccc-9465-66444f02d2d1 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.183818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0452677-c65f-4092-8c20-057d8bc2978a req-86579340-fb63-4ccc-9465-66444f02d2d1 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.184607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d0452677-c65f-4092-8c20-057d8bc2978a req-86579340-fb63-4ccc-9465-66444f02d2d1 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.203927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d0452677-c65f-4092-8c20-057d8bc2978a req-86579340-fb63-4ccc-9465-66444f02d2d1 service nova] Creating event network-vif-unplugged:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:32:34.211326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d0452677-c65f-4092-8c20-057d8bc2978a req-86579340-fb63-4ccc-9465-66444f02d2d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047349 Aug 24 11:32:34.212925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 455/920] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:34.314973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.323044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43b4da72-c1ea-4891-a7c1-d93a2d03400b tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.215096 Aug 24 11:32:34.323596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 466/921] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:34.489963 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.491949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.501839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.502482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.503154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.504390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.505125 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.505773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.580968 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.581677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.588206 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.588792 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.589495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.590455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.591131 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.591794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.739501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.747856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e55bbdb-1e73-438f-add5-56a5154b7afd tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.171514 Aug 24 11:32:34.748437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 467/922] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:34.753636 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.754471 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] [instance: 91bc3b79-e078-405a-9d06-0a01d90b0dde] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.759500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.767047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.767982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.768143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.768743 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.768925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.769535 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.770039 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.770391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:34.771605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f11e9c9e-4764-4ca3-82db-a11a45ffb062 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1725 microversion: 2.20 time: 0.288203 Aug 24 11:32:34.772143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 456/923] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:34.785857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] HTTP exception thrown: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde could not be found. Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Request method failure captured: Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde HTTP/1.1 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrhz4gfHQU5F4BnbUrdMt4WvJrVKE326M2yKdG7ug6Zhfb5tlFsGbS8RBWl0IB6CA6GP6gejXKiplrbCPi7U-5iqCSIS09L1d3J_GrtWlp4FenA1OQmHXvTDAxoPAyKHcvefMTruSghEIXli1ol3_s2nbKmvMYHvn18His6ubYUa08 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:32:34.787785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a049f6edc63419f8fc6895f3ee878f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 8a049f6edc63419f8fc6895f3ee878f7 Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568461563 Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 6f7224ed18ba423084846da68a920f52 Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568461563-project Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde could not be found. Aug 24 11:32:34.789450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '91bc3b79-e078-405a-9d06-0a01d90b0dde'} Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde could not be found. Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:34.790856 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde could not be found. Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde could not be found. Aug 24 11:32:34.794506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:32:34.799491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] Returning 404 to user: Instance 91bc3b79-e078-405a-9d06-0a01d90b0dde could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:34.799491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9600c15-fd0d-404a-8cf3-b0092d3fafb6 tempest-ServerRescueNegativeTestJSON-568461563 tempest-ServerRescueNegativeTestJSON-568461563-project] 10.222.0.17 "GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde" status: 404 len: 111 microversion: 2.1 time: 0.040590 Aug 24 11:32:34.799491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 468/924] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/91bc3b79-e078-405a-9d06-0a01d90b0dde => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:32:34.800211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85668b6d-ec7f-4e82-bdd9-9a457f1c1ede"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:34.800211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.809254 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.809744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.810331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.811064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.811520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.812043 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.148588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ecf9c80d-0f8b-405c-9e20-02846f44a1cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.356775 Aug 24 11:32:35.149227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 457/925] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Aug 24 11:32:34 2022] POST /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-volume_attachments => generated 188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:32:35.300900 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.301513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.308417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.309108 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.309620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.310643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.310643 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.311253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.345666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.348913 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.355975 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.356567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.357075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.358034 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.358552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.359045 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.533074 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.543012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-33dda1b3-b354-47e1-8d5e-a4fe7f3af1e0 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.202169 Aug 24 11:32:35.543690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 458/926] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:35.616617 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71477cb7-e55e-45a4-aad4-ba6ccd51d948 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-volume_attachments/85668b6d-ec7f-4e82-bdd9-9a457f1c1ede" status: 202 len: 0 microversion: 2.20 time: 0.320025 Aug 24 11:32:35.617592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 469/927] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Aug 24 11:32:35 2022] DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-volume_attachments/85668b6d-ec7f-4e82-bdd9-9a457f1c1ede => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:35.693770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:35.694371 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.700518 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.701002 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.701500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.702220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.702764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.703911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.737079 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:32:35.772926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.774228 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.785456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.786783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.787896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.789179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.790100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.790530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.822378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f87bc361-d87e-4ab2-9f05-e91fc5b81e91 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "POST /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/action" status: 202 len: 0 microversion: 2.20 time: 0.136461 Aug 24 11:32:35.823189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 459/928] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 24 11:32:35 2022] POST /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:35.833403 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:35.834709 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:35.841760 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.842210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.842716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.843481 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:35.843980 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:35.844408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.044463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.082769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.084292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.085532 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-34cbb646-1b55-4538-a93e-4bb75ec2d865 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1673 microversion: 2.20 time: 0.256073 Aug 24 11:32:36.086297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 460/929] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:36.151199 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.164281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b306f3c0-e7c0-4535-932f-d66796592382 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.397769 Aug 24 11:32:36.165149 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 470/930] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:35 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:36.567464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.568821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.576480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.577065 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.577613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.578439 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.579605 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.580135 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.892603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.908000 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55c30575-d31d-4b24-9a37-d579e7652e46 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.345210 Aug 24 11:32:36.918895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 461/931] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:37.129110 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.130497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.139427 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.140555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.141861 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.142868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.144217 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.144902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.187286 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.195506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.206467 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.208610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.209230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.211118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.213799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.214438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.306941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.332462 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.337247 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.340930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-172e2431-9e7b-4661-aaba-043dba18238f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1673 microversion: 2.20 time: 0.219525 Aug 24 11:32:37.347210 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 471/932] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:37.488206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.498429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bb794f90-d537-4a0c-a891-b37c2d76f378 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.314862 Aug 24 11:32:37.499016 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 462/933] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:37.941319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.941967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.949908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.950199 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.950639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.951356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.951808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.952234 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.123505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.133723 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-951a9efe-e65d-4806-9219-ee229c508b59 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1756 microversion: 2.1 time: 0.197395 Aug 24 11:32:38.135249 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 472/934] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:38.231239 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-7f224a3f-058c-4640-b6ed-db8eb328df39 req-118166c5-3a9c-43c3-af49-5e8a7e126818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7f5ac0-3211-4d69-bcec-99f90bab124c", "name": "network-vif-plugged", "status": "completed", "tag": "df280a3d-128e-49e9-95e6-48cbd65aff9d"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:38.246985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f224a3f-058c-4640-b6ed-db8eb328df39 req-118166c5-3a9c-43c3-af49-5e8a7e126818 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.247953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f224a3f-058c-4640-b6ed-db8eb328df39 req-118166c5-3a9c-43c3-af49-5e8a7e126818 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.248527 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-7f224a3f-058c-4640-b6ed-db8eb328df39 req-118166c5-3a9c-43c3-af49-5e8a7e126818 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.267035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-7f224a3f-058c-4640-b6ed-db8eb328df39 req-118166c5-3a9c-43c3-af49-5e8a7e126818 service nova] Creating event network-vif-plugged:df280a3d-128e-49e9-95e6-48cbd65aff9d for instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c on hv-cinder-85427 Aug 24 11:32:38.273094 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-7f224a3f-058c-4640-b6ed-db8eb328df39 req-118166c5-3a9c-43c3-af49-5e8a7e126818 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049294 Aug 24 11:32:38.274853 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 463/935] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:38.367355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.368353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.382271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.383157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.385964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.386985 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.388176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.388808 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.535549 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.536460 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.546153 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.546800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.547549 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.548388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.549109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.549775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.746713 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.757547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.759366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.760624 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.761103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09ba95b0-22dc-4c13-b2f6-1627021e60fe tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.397676 Aug 24 11:32:38.762613 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 473/936] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:38.771335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a5843db0-b494-4a99-a711-435732aa176b tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.244245 Aug 24 11:32:38.772281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 464/937] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:39.156990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.157838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.164559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.165034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.165602 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.166239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.166698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.167130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.588397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.590875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.602254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dae5a0e6-c8b6-4a83-8439-c5e1ecd3737a tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1759 microversion: 2.1 time: 0.449214 Aug 24 11:32:39.602848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 474/938] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1759 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:39.795032 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.796242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.805118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.806988 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.809908 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.810844 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.811686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.814496 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.815665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.816993 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.818586 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.820126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.821099 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.822560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.823500 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.824358 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.081881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.092136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.094981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.096790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1340bc92-7ae0-46d6-a377-740f0ecb1b8f tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.297566 Aug 24 11:32:40.097797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 475/939] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:40.312084 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.320627 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1b6cc9f3-c9a1-447c-8c78-3e7f238f485c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1362 microversion: 2.1 time: 0.531814 Aug 24 11:32:40.321477 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 465/940] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.120404 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.121152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.128703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.129226 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.129644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.130687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.131145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.131570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.177719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.179946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.195352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.196188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.196891 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.197996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.198784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.199480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.259543 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:41.305276 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:41.344467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.354418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.356213 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.357663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5921849c-1a16-49fd-aebd-7cbc4c950d56 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.241087 Aug 24 11:32:41.358513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 476/941] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:41.381514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.382319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.393738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.394839 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.395445 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.396322 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.396976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.397597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.415203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-07382148-9339-4d2f-a467-75a06cae26f7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 204 len: 0 microversion: 2.1 time: 0.244706 Aug 24 11:32:41.417063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 466/942] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:41 2022] DELETE /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:41.427665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.428471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.435195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.435906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.436420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.437229 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.438267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.438763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.639482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.660250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-264e94cb-9203-4fa3-ada2-a6855d25c644 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1546 microversion: 2.1 time: 0.283899 Aug 24 11:32:41.660837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 477/943] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1546 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.674352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.684558 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae5455f4-54cf-4801-9f2a-024bcd403835 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.261656 Aug 24 11:32:41.685564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 467/944] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.698230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.699081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.711556 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.712465 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.713242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.714274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.715505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.716526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.804114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f5817c6-030c-401e-bb1e-3681ea293394 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122061 Aug 24 11:32:41.804858 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 478/945] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:42.118893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.120396 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.126386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.127014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.127950 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.128769 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.129502 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.130032 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.162860 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-648e5df4-0153-4654-86e6-a9d0de0f2030 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/ips" status: 200 len: 149 microversion: 2.1 time: 0.048177 Aug 24 11:32:42.164025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 468/946] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:42.388964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.389761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.407086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.409665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.410177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.410958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.411422 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.411863 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.714360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.721766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.723027 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.738231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.740257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.741789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-416688a8-2ef2-458a-94e0-b983d0064a3b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.359076 Aug 24 11:32:42.742435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 479/947] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:42.743127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.744267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.745035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.745966 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.748453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.748453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.960524 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.971236 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5f798461-06cc-4b3f-aaa1-fc0023a6a075 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.260286 Aug 24 11:32:42.972026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 469/948] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.097128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-99c3a8ae-1622-4292-b6df-c7195577cdb3 req-fbfa8929-7488-4daa-99fe-1e529c02073e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7f5ac0-3211-4d69-bcec-99f90bab124c", "tag": "df280a3d-128e-49e9-95e6-48cbd65aff9d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:43.113407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-99c3a8ae-1622-4292-b6df-c7195577cdb3 req-fbfa8929-7488-4daa-99fe-1e529c02073e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.114176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-99c3a8ae-1622-4292-b6df-c7195577cdb3 req-fbfa8929-7488-4daa-99fe-1e529c02073e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.114932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-99c3a8ae-1622-4292-b6df-c7195577cdb3 req-fbfa8929-7488-4daa-99fe-1e529c02073e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.129664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-99c3a8ae-1622-4292-b6df-c7195577cdb3 req-fbfa8929-7488-4daa-99fe-1e529c02073e service nova] Creating event network-changed:df280a3d-128e-49e9-95e6-48cbd65aff9d for instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c on hv-cinder-85427 Aug 24 11:32:43.135281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-99c3a8ae-1622-4292-b6df-c7195577cdb3 req-fbfa8929-7488-4daa-99fe-1e529c02073e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042143 Aug 24 11:32:43.142144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 480/949] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:43.654958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06beb807-983d-4514-9b43-c4026c72365a"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:43.659686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.673255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.674509 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.675280 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.676789 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.677638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.678615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.779360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.780283 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.803241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.803748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.804194 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.804922 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.805417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.811319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.116443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.130239 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.135241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.139922 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31a04403-a6f7-43d9-b39b-22ee2c8b4773 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.366932 Aug 24 11:32:44.147550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 481/950] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:44.154348 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.165086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.180488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.186122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.186588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.188529 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.189062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.189547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.485378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.495625 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f05b1d7e-75bb-466b-aa5c-bc3690b46edb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.346660 Aug 24 11:32:44.496231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 482/951] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.187043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.188932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.203820 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.208219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.208680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.209514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.209981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.210411 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.447350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.457309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.460146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.461577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0cc40be1-0a65-4b61-8f51-562e1f0aa621 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.279293 Aug 24 11:32:45.462675 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 483/952] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:45.520363 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.521308 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.523555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.535804 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.537815 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.538521 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.539909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.542046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.542678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.746550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.760744 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-975a052b-788b-466b-bc29-4b2854653162 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.244784 Aug 24 11:32:45.773911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 484/953] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:46.485534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.486431 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.493383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.493989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.494449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.495187 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.495642 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.496098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.646535 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.655459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.657998 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.659340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cb75778f-8714-458b-995c-97aa12fc1dcd tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.178700 Aug 24 11:32:46.660222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 485/954] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:46.785947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.786568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.792912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.793649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.794108 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.794995 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.795511 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.796039 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.955652 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.963378 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-091d4cac-3747-42cd-9722-ea7a69098fd3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.182623 Aug 24 11:32:46.963950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 486/955] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:47.682819 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.683554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.690810 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.692193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.692193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.692463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.692897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.693447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.843295 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.856336 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.858052 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.860253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b21d9f5-7c47-45e6-960d-7e5351fe802d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.180376 Aug 24 11:32:47.860986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 487/956] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:47.990802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.991572 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.997975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.998565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.999003 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.999741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.000266 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.000930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.161501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.170504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c74d13a9-acf0-4fba-9353-a0840f365cda tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.183622 Aug 24 11:32:48.171508 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 488/957] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:48.884167 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.884771 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.891690 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.892224 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.892651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.893459 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.893942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.894874 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.061661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.071560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.072916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.078095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0a64f58-89cd-4ad6-aaf9-735039f72a1d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.193876 Aug 24 11:32:49.079347 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 489/958] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:49.192894 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:49.193633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:49.202096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.203749 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.204409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.205371 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:49.206068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:49.206676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:49.386156 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:49.397442 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef789e81-0365-4c69-9447-221f38f753dc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.209102 Aug 24 11:32:49.398361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 490/959] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:49 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:50.103714 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.104482 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.112337 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.112838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.113313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.114089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.114527 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.114959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.346717 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.358501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.360941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.362250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bd5f130-9df8-45be-a2a5-315935aab412 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.263217 Aug 24 11:32:50.373251 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 491/960] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:50.420132 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.420832 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.432516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.433945 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.434399 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.436586 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.437090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.438903 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.468182 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:50.628116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.636396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddfdc806-ff01-4cd0-9204-06a63b29dc03 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.220069 Aug 24 11:32:50.637082 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 492/961] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:51.388880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.389632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.397513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.398000 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.398435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.399646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.400094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.400518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.591588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.601054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.602775 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.604062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48328ad6-dbe3-470a-b057-29d632df9ead tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.220830 Aug 24 11:32:51.604769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 493/962] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:51.629157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c7e2fc4-15ae-4197-b9dc-5a881a7b999d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "POST /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.978238 Aug 24 11:32:51.633355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 470/963] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:32:43 2022] POST /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments => generated 194 bytes in 7983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:51.659075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.659824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.666617 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.667192 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.667702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.668580 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.669045 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.669505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.809400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.818776 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3494da6d-1829-4f3b-a302-448c3b01965d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.163612 Aug 24 11:32:51.819343 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 494/964] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:52.641466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.642327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.649771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.650355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.650865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.651633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.652294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.652792 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.840731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.841445 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.848134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.848790 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.849167 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.849892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.850350 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.850831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.011841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.020988 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36515e9a-b61c-42dc-a992-e08298885422 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1576 microversion: 2.1 time: 0.184870 Aug 24 11:32:53.021779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 495/965] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:53.025511 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.035557 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.037091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.038304 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6361986f-e495-4d8c-b242-a33c2d48fe7d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.402608 Aug 24 11:32:53.038859 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 471/966] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:53.820073 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-16c76277-b905-4f28-818e-f3dd13d0ae16 req-bf8b8615-2469-4fbb-937e-6f06b10f792c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca60a3-533e-48ea-a0f9-5fd4270c8164", "name": "network-vif-deleted", "tag": "25d08f8b-13c5-422c-9daf-0dc66360742f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:53.836779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-16c76277-b905-4f28-818e-f3dd13d0ae16 req-bf8b8615-2469-4fbb-937e-6f06b10f792c service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.837610 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-16c76277-b905-4f28-818e-f3dd13d0ae16 req-bf8b8615-2469-4fbb-937e-6f06b10f792c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.838973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-16c76277-b905-4f28-818e-f3dd13d0ae16 req-bf8b8615-2469-4fbb-937e-6f06b10f792c service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.855760 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-16c76277-b905-4f28-818e-f3dd13d0ae16 req-bf8b8615-2469-4fbb-937e-6f06b10f792c service nova] Creating event network-vif-deleted:25d08f8b-13c5-422c-9daf-0dc66360742f for instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 on hv-cinder-85427 Aug 24 11:32:53.865128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-16c76277-b905-4f28-818e-f3dd13d0ae16 req-bf8b8615-2469-4fbb-937e-6f06b10f792c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048380 Aug 24 11:32:53.866023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 496/967] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:54.051048 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:54.051740 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.060143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.060648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.061085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.061821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.062794 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:54.063046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.063483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.063922 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.070967 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.071723 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.072168 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.072869 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.073513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.075209 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.142083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.153260 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-adf7860a-79c8-4e78-b325-b3801ae63f9c tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 200 len: 1224 microversion: 2.1 time: 0.107371 Aug 24 11:32:54.153933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 472/968] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:54 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:54.250574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.261549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.263666 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.265291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6665a281-b274-4f27-93f7-83ec7451d309 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.207046 Aug 24 11:32:54.266682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 497/969] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:54 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:55.176517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:55.178007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:55.186614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.187166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.187872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.188791 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.189324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.189941 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.206972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] HTTP exception thrown: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Request method failure captured: Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 HTTP/1.1 Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBguipREvgerYP2Ri8eioU33XRfCHSLu-FRVbFfoMijbiRqcyYhOWoKu6tYubooNM3ZeA2512nkL6Wt0MHO3oT98zhddjlDSKkv49XPHpbho8HycHZLtdncc9PZmA2HwZZCxMNmJdfwy7mhxHc9iuhBp_imcff1SlyVrJ8FWQDC9QSXs Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: e54623c55367410db8070615915e573e Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:32:55.208623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e54623c55367410db8070615915e573e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e54623c55367410db8070615915e573e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: e54623c55367410db8070615915e573e Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: cbeabb83431b4536b4c5fdf71e8a5a80 Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:32:55.210461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '75ca60a3-533e-48ea-a0f9-5fd4270c8164'} Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:55.211367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:32:55.213341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:32:55.215852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Returning 404 to user: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:55.215852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1fb128d1-9afb-4b89-9503-5ae687705b37 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 404 len: 111 microversion: 2.1 time: 0.038607 Aug 24 11:32:55.215852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 473/970] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:55 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:32:55.299987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:55.300857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:55.309748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.310645 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.311088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.312711 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.313244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.313884 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.350748 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1730995975", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-564613301", "security_groups": [{"name": "tempest-secgroup-smoke-900977225"}], "block_device_mapping_v2": [{"uuid": "332805b6-f38d-4322-9a26-fa7fb2755652", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "76bed7fc-2ca1-4c54-8559-9ea4dba9aee6"}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:55.468340 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:55.477591 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:55.479159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:55.480395 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6628f796-0ad1-4eb5-8c02-43821839065d tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.186239 Aug 24 11:32:55.481033 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 498/971] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:55 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:55.492069 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] validate_networks() for [('76bed7fc-2ca1-4c54-8559-9ea4dba9aee6', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:32:55.877743 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:32:55.878175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:32:55.878658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:32:55.879128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:32:55.879541 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:32:55.889811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.890309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.891075 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.891877 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.892420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.892850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.911359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for project e54623c55367410db8070615915e573e. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:55.915686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for user cbeabb83431b4536b4c5fdf71e8a5a80 and project e54623c55367410db8070615915e573e. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:55.981596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:32:55.983915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='332805b6-f38d-4322-9a26-fa7fb2755652',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:32:56.128007 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd50b5ef-2491-4e03-a874-4ed83611792b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.782426 Aug 24 11:32:56.128880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 474/972] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:32:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:32:56.140990 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4781ce83-4164-48a5-8d2b-d3ad9ac94196 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:56.141677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4781ce83-4164-48a5-8d2b-d3ad9ac94196 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:56.249250 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4781ce83-4164-48a5-8d2b-d3ad9ac94196 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.259648 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4781ce83-4164-48a5-8d2b-d3ad9ac94196 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1094 microversion: 2.1 time: 0.122972 Aug 24 11:32:56.261513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 499/973] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:56 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1094 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:56.310190 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-e2d177c6-8a75-4aa8-b1b5-420eab3619a5 req-9d2d4c6c-486c-479b-b4a0-4abcb56ce38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "name": "network-vif-plugged", "status": "completed", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:56.323658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2d177c6-8a75-4aa8-b1b5-420eab3619a5 req-9d2d4c6c-486c-479b-b4a0-4abcb56ce38e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.324362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2d177c6-8a75-4aa8-b1b5-420eab3619a5 req-9d2d4c6c-486c-479b-b4a0-4abcb56ce38e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.325142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-e2d177c6-8a75-4aa8-b1b5-420eab3619a5 req-9d2d4c6c-486c-479b-b4a0-4abcb56ce38e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.340289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-e2d177c6-8a75-4aa8-b1b5-420eab3619a5 req-9d2d4c6c-486c-479b-b4a0-4abcb56ce38e service nova] Creating event network-vif-plugged:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:32:56.346712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-e2d177c6-8a75-4aa8-b1b5-420eab3619a5 req-9d2d4c6c-486c-479b-b4a0-4abcb56ce38e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040864 Aug 24 11:32:56.347461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 475/974] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:56.503806 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:56.504570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:56.511812 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.512686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.512973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.513731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:56.514244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:56.515006 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.666994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.676952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.678805 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.680026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0ecbce33-9452-4f31-a049-8e99e14e03f6 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.180690 Aug 24 11:32:56.680661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 500/975] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:56 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:32:57.281852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:57.282536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:57.288634 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.289116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.289574 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.290358 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.290819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.291235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.370364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.380375 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6b9ce5ce-aede-4823-b76b-2a3b881274c4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1192 microversion: 2.1 time: 0.102987 Aug 24 11:32:57.381141 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 476/976] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:57 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:57.704750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:57.705561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:57.712910 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.713477 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.713958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.714670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.715197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.715841 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.853432 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.861984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.863468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.864618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-75cc0cce-403e-4275-bcfa-feed60ed6dcb tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1731 microversion: 2.20 time: 0.164451 Aug 24 11:32:57.865171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 501/977] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:57 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:58.403100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:58.403888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:58.411395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.411889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.412500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.413121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.413703 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.414156 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.494010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:58.503255 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-aaf034f3-dec7-4887-82ef-30d97fe6cfaa tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1200 microversion: 2.1 time: 0.104063 Aug 24 11:32:58.503828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 477/978] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:58 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:58.892680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:58.895112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:58.902214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.902928 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.903435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.904609 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.905266 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.905703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.066577 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.075942 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.077576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.079206 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c4e905a-d528-4e84-8f55-90b0afdf7ccf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1718 microversion: 2.20 time: 0.193726 Aug 24 11:32:59.093509 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 502/979] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:32:58 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1718 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:32:59.525300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:59.526151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:59.533351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.533850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.534294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.535014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.535469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.535907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.646199 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.658138 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da6cb82b-2639-4d99-b915-46298e5724c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1210 microversion: 2.1 time: 0.137243 Aug 24 11:32:59.658932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 478/980] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:59 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:00.620886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.621427 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.629720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.630849 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.631495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.632888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.633684 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.634376 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.692536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.693639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.708683 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.709580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.710341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.712046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.712859 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.713681 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.747683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'services' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:00.833789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-748c6a38-ed85-41de-90de-d24208576683 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments/06beb807-983d-4514-9b43-c4026c72365a" status: 202 len: 0 microversion: 2.1 time: 0.217101 Aug 24 11:33:00.834436 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 503/981] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:00 2022] DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments/06beb807-983d-4514-9b43-c4026c72365a => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:00.848637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.851613 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.858059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.858674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.859417 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.860493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.861008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.861530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.895032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-44eb8f8f-4906-433f-8af0-cb8a54ded10b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056024 Aug 24 11:33:00.895653 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 504/982] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:00.965823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:00.982327 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-228eed8f-5826-4b5d-bd13-0ac193c2ce19 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.297000 Aug 24 11:33:00.983315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 479/983] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:01.075059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2f9c4642-b5af-4f3c-8e77-116692dd6791 req-df20b9ce-f3ea-4bec-a199-515ab022b87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9a21fe-45de-4237-a6e4-2f089bf93fcb", "tag": "31271296-5c4a-403b-a533-e376d7b48425"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:01.086113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f9c4642-b5af-4f3c-8e77-116692dd6791 req-df20b9ce-f3ea-4bec-a199-515ab022b87e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.086699 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f9c4642-b5af-4f3c-8e77-116692dd6791 req-df20b9ce-f3ea-4bec-a199-515ab022b87e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.087319 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2f9c4642-b5af-4f3c-8e77-116692dd6791 req-df20b9ce-f3ea-4bec-a199-515ab022b87e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.100024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2f9c4642-b5af-4f3c-8e77-116692dd6791 req-df20b9ce-f3ea-4bec-a199-515ab022b87e service nova] Creating event network-changed:31271296-5c4a-403b-a533-e376d7b48425 for instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb on hv-cinder-85427 Aug 24 11:33:01.104667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2f9c4642-b5af-4f3c-8e77-116692dd6791 req-df20b9ce-f3ea-4bec-a199-515ab022b87e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033209 Aug 24 11:33:01.105426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 505/984] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:01.911009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:01.913372 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:01.922530 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.922745 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.923838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.924700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.925603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.926049 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.961938 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8b9020f-5f20-4308-ac31-62703fc71a2a tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057320 Aug 24 11:33:01.962517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 480/985] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:33:02.006661 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:02.007424 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:02.013922 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.014443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.014883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.016589 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.017116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.017570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.031874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:02.032556 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:02.038911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.039683 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.040117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.040832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.041301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.041721 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.067806 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:02.132169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:02.191623 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:02.195846 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-668c937a-256a-4f98-adac-0217b1f818fb tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 204 len: 0 microversion: 2.1 time: 0.168088 Aug 24 11:33:02.196454 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 481/986] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:02 2022] DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:02.201339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bdd26e42-0c3a-425b-b940-c7c1df98a1f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.200382 Aug 24 11:33:02.202047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 506/987] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:02.206682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:02.207435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:02.214265 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.214666 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.215279 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.216272 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.216849 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.217341 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.363898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:02.372401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c5130319-c424-4dc3-985d-83178b689b46 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1680 microversion: 2.1 time: 0.171413 Aug 24 11:33:02.372999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 482/988] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:02 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:03.235327 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:03.236002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:03.243502 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.243993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.244437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.245158 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.245644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.246075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.394997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:03.395734 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:03.398167 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.403537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.404033 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.404473 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.405175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.405662 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.406813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.409040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:03.422494 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b3c5e34-f73f-41f6-a66e-3b25f5f314d8 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.197252 Aug 24 11:33:03.423618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 507/989] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:03 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:03.563094 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:03.571595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2491d7f0-695e-46e5-9fc3-0c4b94cf87d7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1680 microversion: 2.1 time: 0.181557 Aug 24 11:33:03.572177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 483/990] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:03 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:04.446569 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:04.447338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:04.456383 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.456881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.457361 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.458089 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.458551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.458981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.595087 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:04.595945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:04.603472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.604315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.605102 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.606778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.607704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.607963 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.646073 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:04.655868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-842b53ab-9e33-4dd4-b89d-93e919e7b600 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.213202 Aug 24 11:33:04.656491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 508/991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:04 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:04.909672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:04.918560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b02ac4f4-b262-4eb1-8d05-321418394f43 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1680 microversion: 2.1 time: 0.328669 Aug 24 11:33:04.918962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 484/992] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:04 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1680 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:05.681846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:05.682597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:05.697330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.697962 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.698411 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.699420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.699884 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.700305 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.741257 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-adc559a7-0869-4955-bcdc-914e296c4946 req-7266f93f-851c-4e6e-b714-bf4ab54c930b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7089dba4-3339-49d8-8261-f5cf3be39f41", "name": "network-vif-deleted", "tag": "f68b548e-d366-4cb9-82eb-239e73dbc8ee"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:05.757563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-adc559a7-0869-4955-bcdc-914e296c4946 req-7266f93f-851c-4e6e-b714-bf4ab54c930b service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.758376 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-adc559a7-0869-4955-bcdc-914e296c4946 req-7266f93f-851c-4e6e-b714-bf4ab54c930b service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.759024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-adc559a7-0869-4955-bcdc-914e296c4946 req-7266f93f-851c-4e6e-b714-bf4ab54c930b service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.774626 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-adc559a7-0869-4955-bcdc-914e296c4946 req-7266f93f-851c-4e6e-b714-bf4ab54c930b service nova] Creating event network-vif-deleted:f68b548e-d366-4cb9-82eb-239e73dbc8ee for instance 7089dba4-3339-49d8-8261-f5cf3be39f41 on hv-cinder-85427 Aug 24 11:33:05.783861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-adc559a7-0869-4955-bcdc-914e296c4946 req-7266f93f-851c-4e6e-b714-bf4ab54c930b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047625 Aug 24 11:33:05.785576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 485/993] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:05.898568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:05.907756 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4b9a958-e86c-4364-8ea0-ae52b5e0827b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.229712 Aug 24 11:33:05.908663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 509/994] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:05 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:05.943471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:05.944193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:05.947355 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.948010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.956335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.956835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.957324 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.958047 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.958509 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.958938 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:06.004364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.005149 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.005939 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:06.006410 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:06.055615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:06.064208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-702e11cf-bc57-487e-8a1d-6a08cb885e53 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1331 microversion: 2.1 time: 0.125882 Aug 24 11:33:06.064777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 486/995] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:05 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:06.937984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:06.939179 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:06.942930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.954554 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.954993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.955698 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:06.957101 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:06.957932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:06.958708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.086763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:07.087416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:07.099721 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:07.100566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:07.101328 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.102596 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:07.103116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:07.103918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.150011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:07.152761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:07.153336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:07.153823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:07.153933 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:07.154388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:07.164346 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-001c54ea-4800-42b6-86c9-3ec9d2c756d2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.234355 Aug 24 11:33:07.165631 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 510/996] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:06 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:07.212864 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:07.221588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83d31f27-943b-40c9-a99c-4b3cf40be48c tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1331 microversion: 2.1 time: 0.139030 Aug 24 11:33:07.222181 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 487/997] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:07 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:08.186365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:08.187084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:08.194746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.195235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.195668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.196360 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.196814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.197258 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.244367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:08.245411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:08.256925 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.258539 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.259480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.260939 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.261598 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.262379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.313513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:08.314001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:08.314775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:08.314954 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:08.357419 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:08.363817 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:08.367687 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-dadd165c-b0bf-471a-92e0-42c0f3f74e0d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1331 microversion: 2.1 time: 0.128124 Aug 24 11:33:08.368513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 488/998] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:08 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:08.371403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-286356ec-4619-400d-a87a-f738b30ad6a5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.188883 Aug 24 11:33:08.371951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 511/999] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:08 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:09.392485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:09.393384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:09.393795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:09.394405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:09.399820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.400300 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.400732 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.401049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.401574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.401690 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.402005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.402150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.402456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.402686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.403132 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.403542 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.434949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.435433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.435859 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.436302 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:09.482172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:09.494221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9defb398-2186-4351-9733-5b9280602ad1 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1331 microversion: 2.1 time: 0.106558 Aug 24 11:33:09.494817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 489/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:09 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:09.553188 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:09.562948 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-74d29ea5-e1f4-4b62-a098-50908a58be1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.173031 Aug 24 11:33:09.563541 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 512/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:09 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:10.516719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:10.517357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:10.524093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.524330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.524593 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.525514 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.525968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.526389 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.561456 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.562810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.563642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.564103 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:10.584707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:10.585513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:10.595458 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.595989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.596418 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.597110 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.597579 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.597994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.611114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:10.620117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae3dfdd0-3fa9-428c-b57b-abcd1c028ce2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1331 microversion: 2.1 time: 0.107610 Aug 24 11:33:10.628072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 490/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:10 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:10.736975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:10.745255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b76dbc7-e458-464a-adff-a1945227ebe9 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.164335 Aug 24 11:33:10.745837 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 513/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:10 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:11.642763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:11.643396 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:11.649778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.650257 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.650703 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.651394 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.651845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.652264 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.685815 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.686349 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.686737 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.687221 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lazy-loading 'fault' on Instance uuid 7089dba4-3339-49d8-8261-f5cf3be39f41 {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:11.732246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478a5bf7e1fe4a3397fad4b84a6d2e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2e1c7bfe2142b6a1453b4f73c08d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:11.742173 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-362e4b98-1565-46e0-a2f6-5e3411f721f7 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 200 len: 1331 microversion: 2.1 time: 0.103851 Aug 24 11:33:11.743079 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 491/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:11 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:11.769257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:11.769919 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:11.776801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.777328 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.777781 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.778497 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.779053 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.779362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.931029 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:11.943309 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4bee81a-ae00-4285-8ef7-160e7b2ccf2e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.179085 Aug 24 11:33:11.943892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 514/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:11 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:12.766750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:12.767373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:12.773984 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.774472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.774918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.775633 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.776093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.776520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.791437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 HTTP/1.1 Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:12.793162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:12.794551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '7089dba4-3339-49d8-8261-f5cf3be39f41'} Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:12.795298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:12.796562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:12.798687 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:12.798687 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0f8d3f51-1728-4191-9231-0b34213ef9c6 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 404 len: 111 microversion: 2.1 time: 0.032374 Aug 24 11:33:12.798687 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 492/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:12 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:12.804787 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b7ec165-8d94-4016-b4d8-6ef9ddb2d6c9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '.version_select at 0x7f5ba483e820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:12.826559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b7ec165-8d94-4016-b4d8-6ef9ddb2d6c9 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894410485" status: 202 len: 0 microversion: 2.1 time: 0.025435 Aug 24 11:33:12.827323 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 515/1007] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 11:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894410485 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:12.967566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:12.969843 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:12.988784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.989308 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.989952 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.990845 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.991615 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.992175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:13.280359 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:13.292201 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e1604e29-519a-449f-9eac-da0b0a4d3bb5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.331507 Aug 24 11:33:13.293042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 493/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:12 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:14.320973 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:14.321765 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:14.328784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.329476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.330006 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.330814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.331365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.331897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.501300 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:14.511700 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa23038d-70de-47de-a7d4-4444d84ae260 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.195692 Aug 24 11:33:14.522007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 516/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:14 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:14.790660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:14.791522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:14.800022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.800510 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.800942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.801672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.802121 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.802539 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.823080 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 HTTP/1.1 Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:14.823719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.826413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '7089dba4-3339-49d8-8261-f5cf3be39f41'} Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:14.828208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.831018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.833385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:14.833385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-fe08ff32-0244-4e2d-8b55-915ece4d2c27 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 404 len: 111 microversion: 2.1 time: 0.038994 Aug 24 11:33:14.833385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 494/1010] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:14 2022] DELETE /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:14.841953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:14.842708 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 7089dba4-3339-49d8-8261-f5cf3be39f41] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:14.850251 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.851365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.851365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.851877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.852330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.852755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.866971 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 HTTP/1.1 Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:33:14.868599 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.870227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '7089dba4-3339-49d8-8261-f5cf3be39f41'} Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:14.871177 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. Aug 24 11:33:14.872604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:14.873941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance 7089dba4-3339-49d8-8261-f5cf3be39f41 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:14.873941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be53485c-9c64-48f8-945b-4c523f65241b tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41" status: 404 len: 111 microversion: 2.1 time: 0.034550 Aug 24 11:33:14.873941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 517/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:14 2022] GET /compute/v2.1/servers/7089dba4-3339-49d8-8261-f5cf3be39f41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:33:15.533008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:15.533650 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:15.539817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.540333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.540829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.541753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.542210 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.542629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.684014 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:15.693026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c0d252ff-4a65-4d56-961b-5fd37b803eee tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.163918 Aug 24 11:33:15.693903 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 495/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:15 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:16.033044 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.033616 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.035866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.040882 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.041397 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.041883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.042594 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.043042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.043462 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.059391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 HTTP/1.1 Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:33:16.061018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.064043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e4aa9e46-2498-48fe-a81e-c661818bf0b2'} Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:16.065387 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.066883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.069611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:16.069611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b830aeb6-fb04-4e95-81c6-f63494f635b3 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 404 len: 111 microversion: 2.1 time: 0.034045 Aug 24 11:33:16.069611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 518/1013] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:16 2022] DELETE /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:16.072895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.074096 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: e4aa9e46-2498-48fe-a81e-c661818bf0b2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.083031 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.083522 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.083961 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.084659 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.085113 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.085567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.098949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 HTTP/1.1 Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:16.100505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.102301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'e4aa9e46-2498-48fe-a81e-c661818bf0b2'} Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:16.103269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. Aug 24 11:33:16.104560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.105775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance e4aa9e46-2498-48fe-a81e-c661818bf0b2 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:16.105775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ce9d94a-8fee-4f14-9e1b-15b8ffe5a461 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2" status: 404 len: 111 microversion: 2.1 time: 0.033501 Aug 24 11:33:16.105775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 496/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/e4aa9e46-2498-48fe-a81e-c661818bf0b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:16.110588 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.111082 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.117071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.117656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.118084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.118769 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.119219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.119641 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.135718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 HTTP/1.1 Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:33:16.137276 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.138836 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '0d5bdc96-1c5a-48e7-99b6-27d354088d77'} Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:16.140412 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.141750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.143421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:16.143421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af29d57f-f010-441d-971c-f928e32d635d tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 404 len: 111 microversion: 2.1 time: 0.031956 Aug 24 11:33:16.143421 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 519/1015] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:16 2022] DELETE /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:16.148067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.148688 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: 0d5bdc96-1c5a-48e7-99b6-27d354088d77] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.154816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.155348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.156136 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.156980 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.157473 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.157905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.171996 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 HTTP/1.1 Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:16.173540 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.175062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '0d5bdc96-1c5a-48e7-99b6-27d354088d77'} Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:16.175905 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. Aug 24 11:33:16.177398 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:16.178625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance 0d5bdc96-1c5a-48e7-99b6-27d354088d77 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:16.178625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-03da04b7-f5d4-4612-8079-43d1d88df2b2 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77" status: 404 len: 111 microversion: 2.1 time: 0.031030 Aug 24 11:33:16.178625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 497/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/0d5bdc96-1c5a-48e7-99b6-27d354088d77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:16.714143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.714670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.722078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.722570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.723008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.723761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.724253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.724682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.776013 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8126cb2c-16be-4c5e-bc16-ca21b6f85de9 req-86373253-60c7-4f0d-8ce8-a5b234b8851e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9a21fe-45de-4237-a6e4-2f089bf93fcb", "name": "network-vif-plugged", "status": "completed", "tag": "31271296-5c4a-403b-a533-e376d7b48425"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:16.786437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8126cb2c-16be-4c5e-bc16-ca21b6f85de9 req-86373253-60c7-4f0d-8ce8-a5b234b8851e service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.787086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8126cb2c-16be-4c5e-bc16-ca21b6f85de9 req-86373253-60c7-4f0d-8ce8-a5b234b8851e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.787655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8126cb2c-16be-4c5e-bc16-ca21b6f85de9 req-86373253-60c7-4f0d-8ce8-a5b234b8851e service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.808726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8126cb2c-16be-4c5e-bc16-ca21b6f85de9 req-86373253-60c7-4f0d-8ce8-a5b234b8851e service nova] Creating event network-vif-plugged:31271296-5c4a-403b-a533-e376d7b48425 for instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb on hv-cinder-85427 Aug 24 11:33:16.814035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8126cb2c-16be-4c5e-bc16-ca21b6f85de9 req-86373253-60c7-4f0d-8ce8-a5b234b8851e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042729 Aug 24 11:33:16.815029 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 498/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:16.874375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:16.884119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca5ff95d-350b-40c4-ac71-faa9712f2897 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.173891 Aug 24 11:33:16.884691 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 520/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:17.328130 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.328718 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.343553 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.344251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.345005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.345772 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.346289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.346968 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.365100 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a HTTP/1.1 Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:17.366835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.368608 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'f2d189eb-9185-44a8-9935-0f111df1392a'} Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:17.369455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.371063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.372675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:17.372675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d97cbe80-909b-49a5-8437-064071a5acb0 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 404 len: 111 microversion: 2.1 time: 0.045231 Aug 24 11:33:17.372675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 499/1019] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:17 2022] DELETE /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:17.379627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.380403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] [instance: f2d189eb-9185-44a8-9935-0f111df1392a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.386802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.387555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.387992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.388741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.389240 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.389656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.409377 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] HTTP exception thrown: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Request method failure captured: Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a HTTP/1.1 Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgrdkUaOBLu9x9UGtZpEeSxemWQYerMUIw9aaJdurXPLYGWbiPB6fseC3EP6bUlxT-Drdjikw3X6-88g6jioQP56soprMWsP0x9LzYsS9L3aQS-1E6DKBZhao7rUVwrdvo-SzhxSN1J93kosA1NG5yVwfOP7qJ0yU_zUmB6MyATIdqs Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:33:17.410913 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2e2e1c7bfe2142b6a1453b4f73c08d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2e2e1c7bfe2142b6a1453b4f73c08d81 Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-40523096 Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 478a5bf7e1fe4a3397fad4b84a6d2e1d Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-40523096-project Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.412268 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'f2d189eb-9185-44a8-9935-0f111df1392a'} Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:17.413019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. Aug 24 11:33:17.414665 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:17.415753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] Returning 404 to user: Instance f2d189eb-9185-44a8-9935-0f111df1392a could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:17.415753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-94172b1e-25d5-4abe-95fe-64398a8f9815 tempest-AttachVolumeNegativeTest-40523096 tempest-AttachVolumeNegativeTest-40523096-project] 10.222.0.17 "GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a" status: 404 len: 111 microversion: 2.1 time: 0.037052 Aug 24 11:33:17.415753 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 521/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/f2d189eb-9185-44a8-9935-0f111df1392a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:17.904618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.905685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.911651 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.912150 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.912591 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.913326 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.913781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.914209 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.153142 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:18.162823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e47ef36a-4a17-4b65-8337-bc4444658670 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1265 microversion: 2.1 time: 0.261955 Aug 24 11:33:18.163287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 500/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:19.184783 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:19.185488 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:19.193096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.193651 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.194145 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.196018 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.196887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.197602 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.351784 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:19.359634 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92615538-b96b-4be8-a877-85fd5fb5125d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1452 microversion: 2.1 time: 0.178825 Aug 24 11:33:19.360261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 522/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:19 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:19.383829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:19.384435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:19.391779 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.392263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.392700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.393425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.393870 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.394285 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.398702 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=100 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.629517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:19.638435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b813c79-e9a9-45d1-b735-7c8d23679b75 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1452 microversion: 2.1 time: 0.258333 Aug 24 11:33:19.639011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 501/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:19 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1452 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:21.842367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-249e1c89-1210-489e-b506-d2a804d2075a req-ed13b961-21f6-496c-b3b1-a0f96627f8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9a21fe-45de-4237-a6e4-2f089bf93fcb", "tag": "31271296-5c4a-403b-a533-e376d7b48425"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:21.858025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-249e1c89-1210-489e-b506-d2a804d2075a req-ed13b961-21f6-496c-b3b1-a0f96627f8d5 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.860367 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-249e1c89-1210-489e-b506-d2a804d2075a req-ed13b961-21f6-496c-b3b1-a0f96627f8d5 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.861161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-249e1c89-1210-489e-b506-d2a804d2075a req-ed13b961-21f6-496c-b3b1-a0f96627f8d5 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.877940 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-249e1c89-1210-489e-b506-d2a804d2075a req-ed13b961-21f6-496c-b3b1-a0f96627f8d5 service nova] Creating event network-changed:31271296-5c4a-403b-a533-e376d7b48425 for instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb on hv-cinder-85427 Aug 24 11:33:21.894059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-249e1c89-1210-489e-b506-d2a804d2075a req-ed13b961-21f6-496c-b3b1-a0f96627f8d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051012 Aug 24 11:33:21.894944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 523/1024] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:26.598788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1326841264"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:26.599537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:26.606325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.606867 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.607290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.608011 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.608503 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.609050 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.777542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.network.security_group_api [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Removing security group 97221822-bffe-4100-81cc-13da4af319fe from port c5005117-2be1-4c59-8e00-4ae454277f0c Aug 24 11:33:27.208018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cd423494-9d10-4c57-b729-0ab0a533c0cd tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.613173 Aug 24 11:33:27.209059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 502/1025] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:33:26 2022] POST /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:33:27.220893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-cbce1288-9b72-4a0a-95f9-4ef546a07c8f req-b1ca2bc6-0dcd-4488-a0e7-bb8528601423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:27.232301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbce1288-9b72-4a0a-95f9-4ef546a07c8f req-b1ca2bc6-0dcd-4488-a0e7-bb8528601423 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.233908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbce1288-9b72-4a0a-95f9-4ef546a07c8f req-b1ca2bc6-0dcd-4488-a0e7-bb8528601423 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.234447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-cbce1288-9b72-4a0a-95f9-4ef546a07c8f req-b1ca2bc6-0dcd-4488-a0e7-bb8528601423 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.263683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-cbce1288-9b72-4a0a-95f9-4ef546a07c8f req-b1ca2bc6-0dcd-4488-a0e7-bb8528601423 service nova] Creating event network-changed:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:33:27.272134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-cbce1288-9b72-4a0a-95f9-4ef546a07c8f req-b1ca2bc6-0dcd-4488-a0e7-bb8528601423 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056419 Aug 24 11:33:27.274117 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 524/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:29.364612 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-0a777712-692d-4311-baa6-875d8b7e8c16 req-4f623782-6d94-45bd-aac5-83ea298fea5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:29.367877 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:29.368391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:29.377552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.378523 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.379093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.380220 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.380983 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.381469 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.391941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0a777712-692d-4311-baa6-875d8b7e8c16 req-4f623782-6d94-45bd-aac5-83ea298fea5b service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.393138 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0a777712-692d-4311-baa6-875d8b7e8c16 req-4f623782-6d94-45bd-aac5-83ea298fea5b service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.394121 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-0a777712-692d-4311-baa6-875d8b7e8c16 req-4f623782-6d94-45bd-aac5-83ea298fea5b service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.413067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-0a777712-692d-4311-baa6-875d8b7e8c16 req-4f623782-6d94-45bd-aac5-83ea298fea5b service nova] Creating event network-changed:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:33:29.419092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-0a777712-692d-4311-baa6-875d8b7e8c16 req-4f623782-6d94-45bd-aac5-83ea298fea5b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058806 Aug 24 11:33:29.419984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 525/1027] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:29.570504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lazy-loading 'services' on Instance uuid 6cae224b-076b-4a7b-aa06-efb1ad17d9fe {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:29.778148 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ae12ae64-d728-4f24-b78c-6e2b9f8afdb2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments/bc13ef9c-c055-48d0-bb4d-31ef04be5843" status: 202 len: 0 microversion: 2.1 time: 0.416638 Aug 24 11:33:29.785263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 503/1028] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:29 2022] DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments/bc13ef9c-c055-48d0-bb4d-31ef04be5843 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:33:29.817388 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:29.827809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:29.862090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.869705 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.880433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:29.882818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:29.883795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:29.886901 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:30.003437 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acbf80b8-8855-4452-8e40-22a2e765a06c tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210981 Aug 24 11:33:30.009382 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 504/1029] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:29 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:30.031534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:30.033986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:30.058409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:30.059720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:30.060407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:30.062219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:30.063316 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:30.063989 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:30.100650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8292a9be-627a-41c0-ad60-3d2be849f4cc tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/ips" status: 200 len: 144 microversion: 2.1 time: 0.636572 Aug 24 11:33:30.101986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 526/1030] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:33:29 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/ips => generated 144 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:31.030723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:31.039030 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:31.052418 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:31.054535 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:31.056076 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:31.058348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:31.062835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:31.062835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:31.110944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0a5a982b-5e09-485b-986e-d6f5e818e3a7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091909 Aug 24 11:33:31.112771 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 505/1031] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:31 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:31.750469 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:31.753682 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:31.760479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:31.761169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:31.761626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:31.762330 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:31.762908 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:31.763478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.130990 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:32.135781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:32.146064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.147123 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.147813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.148784 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.149345 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.150170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.199778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b5683867-59d4-4ec9-a8f7-ca188f570c84 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076943 Aug 24 11:33:32.200839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 506/1032] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:32 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:33:32.232026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:32.237918 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:32.258896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.266283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.267962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.271581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.274500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.284853 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.301349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db87c40a-4405-4ad4-83a2-1368abf77576 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555420 Aug 24 11:33:32.301977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 527/1033] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:33:31 2022] POST /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:32.432726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] HTTP exception thrown: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe is not attached to volume bc13ef9c-c055-48d0-bb4d-31ef04be5843 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Request method failure captured: Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments/bc13ef9c-c055-48d0-bb4d-31ef04be5843 HTTP/1.1 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgvlUnsmGBpURbi5yjX674LfwHOVtdhClwDSJ37a_3i60tcY3rVINDVEBftRdTzn8LFrCmA-BaOqfe1PmrYNwtsu_c4WA09jC58BykZumVFIHDvaIHGy2oOS_JAC9MYdu7AGQS7nLXuAV72QtQ4B00ew_1MrY4svRfy3wvYuR33UT2E Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: eca9f8790d884a86a4abb64ab33b4d42 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-TestMinimumBasicScenario-1632297995 Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:32.444828 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-TestMinimumBasicScenario-1632297995 Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: eca9f8790d884a86a4abb64ab33b4d42 Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1632297995 Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-TestMinimumBasicScenario-1632297995-project Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: bf7576ede68e40c5bc137774e67724bb Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-TestMinimumBasicScenario-1632297995-project Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:32.446383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe is not attached to volume bc13ef9c-c055-48d0-bb4d-31ef04be5843 Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'server_id': '6cae224b-076b-4a7b-aa06-efb1ad17d9fe', 'id': 'bc13ef9c-c055-48d0-bb4d-31ef04be5843'} Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bc13ef9c-c055-48d0-bb4d-31ef04be5843. Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:32.447175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe is not attached to volume bc13ef9c-c055-48d0-bb4d-31ef04be5843 Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe is not attached to volume bc13ef9c-c055-48d0-bb4d-31ef04be5843 Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:32.448395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Returning 404 to user: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe is not attached to volume bc13ef9c-c055-48d0-bb4d-31ef04be5843 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:32.449487 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-472f3aab-423c-48e3-a380-b8e01d573c04 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments/bc13ef9c-c055-48d0-bb4d-31ef04be5843" status: 404 len: 154 microversion: 2.1 time: 0.231092 Aug 24 11:33:32.449487 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 507/1034] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:32 2022] DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe/os-volume_attachments/bc13ef9c-c055-48d0-bb4d-31ef04be5843 => generated 154 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:33.690574 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:33.692613 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:33.704553 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.705278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.705999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:33.707135 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.708038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.708816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:33.762893 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:33.894932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6df3b404-596e-4251-b785-514e0c958b00 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 204 len: 0 microversion: 2.1 time: 0.210760 Aug 24 11:33:33.896272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 528/1035] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:33 2022] DELETE /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:33.906459 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:33.907231 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:33.909562 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=62 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.916028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.916517 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.916960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:33.917735 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.918552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.918981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:34.076920 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:34.085139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4e7c28a5-570d-40a6-9ca7-2c55caf41fe7 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.183173 Aug 24 11:33:34.085800 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 508/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:33 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:35.109565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:35.110936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:35.120649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.120974 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.121452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:35.122356 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.122932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.123495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:35.317939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:35.327455 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-263abf1e-39ae-434a-98e1-22c9cb7e6441 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.222908 Aug 24 11:33:35.328278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 529/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:35 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:36.351649 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:36.352252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:36.359567 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.360373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.361001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.362152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.362916 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.363640 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.544281 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:36.555885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f2ce7196-8f19-4e4a-a095-3033f3ff3d63 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.208654 Aug 24 11:33:36.557132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 509/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:36 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:37.578791 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:37.580002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:37.592068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:37.592755 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:37.593287 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:37.594038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:37.602656 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:37.603123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:37.623209 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.813932 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:37.828211 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-574cc663-2426-4b99-974c-76043cf02dc8 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.253747 Aug 24 11:33:37.829585 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 530/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:37 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:38.853118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:38.853974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:38.864090 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:38.864937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:38.865732 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:38.866935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:38.867701 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:38.868399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:39.046391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:39.054495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8db29300-b8dc-44a6-9146-9216bb148d47 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.205897 Aug 24 11:33:39.054932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 510/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:38 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:40.014274 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:40.016548 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:40.023260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.023750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.024163 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.024847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.025619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.025976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.059847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b9d3b30-7ab0-44e6-8e09-7b5bed9cde7c tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049389 Aug 24 11:33:40.060420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 531/1041] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 24 11:33:40 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:40.079675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:40.080408 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:40.090964 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.091627 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.092933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.093974 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.094559 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.095062 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.127684 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:40.128170 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:40.134546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.135029 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.135457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.136164 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.136816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.137261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.168833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:40.264499 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:40.276118 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e34f7a6b-2fb9-40a6-a564-3dce40d369ca tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 204 len: 0 microversion: 2.20 time: 0.152148 Aug 24 11:33:40.276351 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-da669f46-cde6-47a2-8a54-4d947c799f81 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.200528 Aug 24 11:33:40.276735 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 532/1042] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 11:33:40 2022] DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 11:33:40.281637 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 511/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:40 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:40.287153 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:40.287929 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:40.294534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.295133 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.296078 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.296427 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.296894 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.297357 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.446046 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:40.457931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:40.460146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:40.461854 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e635557c-115d-45c7-980e-65e64e151b6a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.179128 Aug 24 11:33:40.462429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 533/1044] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:40 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:33:41.303788 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:41.305387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:41.332580 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.333086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.338034 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.339010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.339660 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.340917 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.487257 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:41.488271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:41.496847 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.497386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.497811 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.499171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.499607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.500032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.535672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:41.547991 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1c6dfadd-3e5e-4ecc-b746-aa3f02275409 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.248929 Aug 24 11:33:41.549192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 512/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:41 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:41.677503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:41.689086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:41.690607 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:41.691846 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1685dc9f-02ba-406d-b706-efb2754a0789 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.209449 Aug 24 11:33:41.692416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 534/1046] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:41 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:33:42.580820 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:42.581550 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:42.588277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.588833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.589387 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.590189 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.590826 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.591290 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.733715 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:42.735119 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:42.743447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.744201 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.744633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.745560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.746200 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.746788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.848293 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:42.863624 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bf125272-5d57-49d6-b1f5-b5980fc3f0c2 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.286889 Aug 24 11:33:42.865152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 513/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:42 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:42.948269 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:42.960169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:42.962210 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:42.963747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36328920-7a65-44d7-b450-683652e12b83 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.250266 Aug 24 11:33:42.964712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 535/1048] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:42 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:33:43.451969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:43.454722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:43.462696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.463214 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.463775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.465233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.465944 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.466311 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.505781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15da3799-1abc-4276-9002-e62927fc3e44 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058450 Aug 24 11:33:43.519272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:43.520023 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:43.521812 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 514/1049] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:43 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:43.527998 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.528872 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.530096 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.531216 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.531831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.532427 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.569261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f79a80b8-81ae-4dac-890f-afae63d85975 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9" status: 200 len: 194 microversion: 2.1 time: 0.055578 Aug 24 11:33:43.589487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 536/1050] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 24 11:33:43 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:43.898476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:43.899614 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:43.921257 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.921761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.922205 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.922912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:43.925081 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:43.926783 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.993891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:43.994975 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:44.027878 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.028372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.028809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.030375 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.030892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.031401 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.260386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:44.287021 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:44.290855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:44.293478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ea8410ac-9c21-4731-9577-b97f06bc123a tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1724 microversion: 2.20 time: 0.307571 Aug 24 11:33:44.294546 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 537/1051] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:43 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:33:44.423851 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:44.438623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f1496322-ece7-49d6-9558-df7d7eaf42ad tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.549249 Aug 24 11:33:44.440001 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 515/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:43 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1554 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:44.504453 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7dd3369c-3171-477d-bbee-80fc2a1b8880 req-f31b4c0a-710c-42f4-8127-e0f696f367bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae224b-076b-4a7b-aa06-efb1ad17d9fe", "name": "network-vif-deleted", "tag": "c5005117-2be1-4c59-8e00-4ae454277f0c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:44.528461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7dd3369c-3171-477d-bbee-80fc2a1b8880 req-f31b4c0a-710c-42f4-8127-e0f696f367bb service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.529703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7dd3369c-3171-477d-bbee-80fc2a1b8880 req-f31b4c0a-710c-42f4-8127-e0f696f367bb service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.530762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7dd3369c-3171-477d-bbee-80fc2a1b8880 req-f31b4c0a-710c-42f4-8127-e0f696f367bb service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.552923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7dd3369c-3171-477d-bbee-80fc2a1b8880 req-f31b4c0a-710c-42f4-8127-e0f696f367bb service nova] Creating event network-vif-deleted:c5005117-2be1-4c59-8e00-4ae454277f0c for instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe on hv-cinder-85427 Aug 24 11:33:44.563184 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7dd3369c-3171-477d-bbee-80fc2a1b8880 req-f31b4c0a-710c-42f4-8127-e0f696f367bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075152 Aug 24 11:33:44.564290 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 538/1053] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:45.322099 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:45.322991 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:45.331498 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.332165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.333104 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.333958 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.334801 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.335823 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.424162 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:45.437317 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:45.438879 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:45.440064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55f66117-359c-4a6b-b3f1-6cc9fe1830cf tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1656 microversion: 2.20 time: 0.122893 Aug 24 11:33:45.440629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 516/1054] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:45 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1656 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:33:45.467691 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:45.471407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:45.480681 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.481433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.482036 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.483476 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.483941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.484413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.590318 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:45.609501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c3a5d3e-6e98-4aae-86b3-8758d6456096 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1512 microversion: 2.1 time: 0.150562 Aug 24 11:33:45.621227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 539/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:45 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:46.482436 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:46.484421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:46.496399 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.497244 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.498875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.500342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.501051 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.501948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.536312 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.602227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ae4c77a9-9a8c-4b63-91ad-d0a43a2c1015 req-1022926c-8187-4873-9353-834b68cd9d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb47ea0-f421-4999-9a87-35ee20241fb2", "name": "network-vif-deleted", "tag": "fa6543c2-5510-42c0-abbb-ee9b4a1d85a4"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:46.630894 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.641832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:46.654997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae4c77a9-9a8c-4b63-91ad-d0a43a2c1015 req-1022926c-8187-4873-9353-834b68cd9d31 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.655297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:46.656504 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae4c77a9-9a8c-4b63-91ad-d0a43a2c1015 req-1022926c-8187-4873-9353-834b68cd9d31 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.657391 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a2bfeaa15ee4ef3bcaa21e22c71895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0d25ef91a84ff4a1afc307daded734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:46.658002 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ae4c77a9-9a8c-4b63-91ad-d0a43a2c1015 req-1022926c-8187-4873-9353-834b68cd9d31 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.659101 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-94be2545-8217-4208-8b0d-07de2abae76b tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 200 len: 1656 microversion: 2.20 time: 0.183669 Aug 24 11:33:46.669313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 517/1056] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:46 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 1656 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:33:46.686490 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:46.688620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:46.697779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ae4c77a9-9a8c-4b63-91ad-d0a43a2c1015 req-1022926c-8187-4873-9353-834b68cd9d31 service nova] Creating event network-vif-deleted:fa6543c2-5510-42c0-abbb-ee9b4a1d85a4 for instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 on hv-cinder-85427 Aug 24 11:33:46.708426 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ae4c77a9-9a8c-4b63-91ad-d0a43a2c1015 req-1022926c-8187-4873-9353-834b68cd9d31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122954 Aug 24 11:33:46.713120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.714169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.714947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.716267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.716456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 540/1057] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:46.717816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.718546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.802138 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.804110 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.808599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.809505 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lazy-loading 'fault' on Instance uuid 6cae224b-076b-4a7b-aa06-efb1ad17d9fe {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:46.867778 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf7576ede68e40c5bc137774e67724bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca9f8790d884a86a4abb64ab33b4d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:46.881430 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8fe5c9b0-52f5-42a9-bbdb-9d635c490e52 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 200 len: 1348 microversion: 2.1 time: 0.213523 Aug 24 11:33:46.883219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 518/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:46 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 1348 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:47.283088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8502db0e-c973-4c7a-b949-197fdf9005fc"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:47.285795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:47.293467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.294016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.294533 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.296338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.296763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.297289 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.693482 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:47.698839 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:47.710306 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e52e5e82-84ef-4f0e-8923-2afd79f3c879 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "POST /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435077 Aug 24 11:33:47.710888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.711352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.713237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.713381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 541/1059] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 24 11:33:47 2022] POST /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:47.713497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.713818 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.714404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.744631 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] HTTP exception thrown: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Request method failure captured: Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 HTTP/1.1 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgridhnWMGT28Z2E9ps2mtY3Kz5KszNqidiRAQaptjY9xxTiRQ5i06GrlCkZ--fA6MIOj6Nw1TJV0L47vv5lQt2vNJ_aWberl7R4lkIiNx2DlR4SEsReFbVmRfbSlsY1tJGv2IenenbR0M97znpnWEsIDlYfo1MNl7sZpSBU9nvOMCo Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:47.747935 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 6a2bfeaa15ee4ef3bcaa21e22c71895d Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:47.749821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '1eb47ea0-f421-4999-9a87-35ee20241fb2'} Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:47.751635 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:47.753775 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.756271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Returning 404 to user: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:47.756271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4feeb3f0-2c3b-44c4-b028-fce408fbc165 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 404 len: 111 microversion: 2.20 time: 0.064328 Aug 24 11:33:47.756271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 519/1060] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:47 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:33:47.768750 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-076a522d-396d-4666-b246-fdf26b1ba754 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '.version_select at 0x7f5ba48e9430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:47.800464 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-076a522d-396d-4666-b246-fdf26b1ba754 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007654522" status: 204 len: 0 microversion: 2.20 time: 0.041184 Aug 24 11:33:47.801174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 542/1061] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Aug 24 11:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007654522 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 11:33:47.922226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:47.923814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] [instance: 6cae224b-076b-4a7b-aa06-efb1ad17d9fe] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:47.936307 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.937931 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.939099 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.942195 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.943092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.944124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.975933 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] HTTP exception thrown: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe could not be found. Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Request method failure captured: Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe HTTP/1.1 Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgvlUnsmGBpURbi5yjX674LfwHOVtdhClwDSJ37a_3i60tcY3rVINDVEBftRdTzn8LFrCmA-BaOqfe1PmrYNwtsu_c4WA09jC58BykZumVFIHDvaIHGy2oOS_JAC9MYdu7AGQS7nLXuAV72QtQ4B00ew_1MrY4svRfy3wvYuR33UT2E Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: eca9f8790d884a86a4abb64ab33b4d42 Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-TestMinimumBasicScenario-1632297995 Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:47.979414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eca9f8790d884a86a4abb64ab33b4d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-TestMinimumBasicScenario-1632297995 Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: eca9f8790d884a86a4abb64ab33b4d42 Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1632297995 Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-TestMinimumBasicScenario-1632297995-project Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: bf7576ede68e40c5bc137774e67724bb Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-TestMinimumBasicScenario-1632297995-project Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe could not be found. Aug 24 11:33:47.982987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '6cae224b-076b-4a7b-aa06-efb1ad17d9fe'} Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe could not be found. Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:47.984930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe could not be found. Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe could not be found. Aug 24 11:33:47.987953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.992691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Returning 404 to user: Instance 6cae224b-076b-4a7b-aa06-efb1ad17d9fe could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:47.992691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1eb43488-025e-4a46-9e7a-8f6d95164e65 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe" status: 404 len: 111 microversion: 2.1 time: 0.073399 Aug 24 11:33:47.992691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 520/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:47 2022] GET /compute/v2.1/servers/6cae224b-076b-4a7b-aa06-efb1ad17d9fe => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:48.008507 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b38b71e-54da-43f5-93d3-37b586da3e13 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] Calling method '.version_select at 0x7f5ba48b8550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:48.082558 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b38b71e-54da-43f5-93d3-37b586da3e13 tempest-TestMinimumBasicScenario-1632297995 tempest-TestMinimumBasicScenario-1632297995-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-432744994" status: 202 len: 0 microversion: 2.1 time: 0.084745 Aug 24 11:33:48.083450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 543/1063] 10.222.0.17 () {58 vars in 1269 bytes} [Wed Aug 24 11:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-432744994 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:50.208350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:50.210373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:50.230416 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:50.232901 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:50.234847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:50.236203 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:50.237400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:50.238504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:50.264228 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] HTTP exception thrown: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Request method failure captured: Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 HTTP/1.1 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgridhnWMGT28Z2E9ps2mtY3Kz5KszNqidiRAQaptjY9xxTiRQ5i06GrlCkZ--fA6MIOj6Nw1TJV0L47vv5lQt2vNJ_aWberl7R4lkIiNx2DlR4SEsReFbVmRfbSlsY1tJGv2IenenbR0M97znpnWEsIDlYfo1MNl7sZpSBU9nvOMCo Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:50.266994 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 6a2bfeaa15ee4ef3bcaa21e22c71895d Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.268768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '1eb47ea0-f421-4999-9a87-35ee20241fb2'} Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:50.269755 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.271114 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.272581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Returning 404 to user: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:50.272581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0ff60c7e-4569-4fe9-bd64-85b354100a46 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 404 len: 111 microversion: 2.20 time: 0.069534 Aug 24 11:33:50.272581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 521/1064] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 11:33:50 2022] DELETE /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:33:50.281242 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:50.282604 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 1eb47ea0-f421-4999-9a87-35ee20241fb2] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:50.290068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:50.290534 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:50.290949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:50.291627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:50.292085 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:50.292514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:50.307741 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] HTTP exception thrown: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Request method failure captured: Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 HTTP/1.1 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgridhnWMGT28Z2E9ps2mtY3Kz5KszNqidiRAQaptjY9xxTiRQ5i06GrlCkZ--fA6MIOj6Nw1TJV0L47vv5lQt2vNJ_aWberl7R4lkIiNx2DlR4SEsReFbVmRfbSlsY1tJGv2IenenbR0M97znpnWEsIDlYfo1MNl7sZpSBU9nvOMCo Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:33:50.309460 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 6a2bfeaa15ee4ef3bcaa21e22c71895d Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.313005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '1eb47ea0-f421-4999-9a87-35ee20241fb2'} Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:50.315165 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. Aug 24 11:33:50.317567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:50.319385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Returning 404 to user: Instance 1eb47ea0-f421-4999-9a87-35ee20241fb2 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:50.319385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21827459-188e-4348-a656-80312ca89286 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2" status: 404 len: 111 microversion: 2.20 time: 0.036416 Aug 24 11:33:50.319385 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 544/1065] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:50 2022] GET /compute/v2.1/servers/1eb47ea0-f421-4999-9a87-35ee20241fb2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:33:53.691613 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:53.692206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:53.699846 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:53.700348 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:53.700805 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:53.702253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:53.702902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:53.703250 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:53.721386 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] HTTP exception thrown: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Request method failure captured: Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e HTTP/1.1 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgridhnWMGT28Z2E9ps2mtY3Kz5KszNqidiRAQaptjY9xxTiRQ5i06GrlCkZ--fA6MIOj6Nw1TJV0L47vv5lQt2vNJ_aWberl7R4lkIiNx2DlR4SEsReFbVmRfbSlsY1tJGv2IenenbR0M97znpnWEsIDlYfo1MNl7sZpSBU9nvOMCo Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:33:53.723041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 6a2bfeaa15ee4ef3bcaa21e22c71895d Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.725884 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '18aa3b17-222c-4330-a1fd-72ee1a96c82e'} Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:53.727471 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.729722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.731616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Returning 404 to user: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:53.731616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a9ee5193-331b-4894-9807-f358db6d97ce tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 404 len: 111 microversion: 2.20 time: 0.037380 Aug 24 11:33:53.731616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 522/1066] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 24 11:33:53 2022] DELETE /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:33:53.741719 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:53.743650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] [instance: 18aa3b17-222c-4330-a1fd-72ee1a96c82e] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:53.753302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:53.753875 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:53.754509 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:53.755271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:53.755731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:53.756159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:53.784677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] HTTP exception thrown: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Request method failure captured: Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e HTTP/1.1 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgridhnWMGT28Z2E9ps2mtY3Kz5KszNqidiRAQaptjY9xxTiRQ5i06GrlCkZ--fA6MIOj6Nw1TJV0L47vv5lQt2vNJ_aWberl7R4lkIiNx2DlR4SEsReFbVmRfbSlsY1tJGv2IenenbR0M97znpnWEsIDlYfo1MNl7sZpSBU9nvOMCo Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:33:53.786814 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9e0d25ef91a84ff4a1afc307daded734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 9e0d25ef91a84ff4a1afc307daded734 Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1291932584 Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 6a2bfeaa15ee4ef3bcaa21e22c71895d Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1291932584-project Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.788296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '18aa3b17-222c-4330-a1fd-72ee1a96c82e'} Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:53.789048 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. Aug 24 11:33:53.791005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:33:53.792227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] Returning 404 to user: Instance 18aa3b17-222c-4330-a1fd-72ee1a96c82e could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:53.792227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aac14e96-4233-4935-aebe-b22d5350b7b9 tempest-AttachVolumeShelveTestJSON-1291932584 tempest-AttachVolumeShelveTestJSON-1291932584-project] 10.222.0.17 "GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e" status: 404 len: 111 microversion: 2.20 time: 0.053940 Aug 24 11:33:53.792227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 545/1067] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:53 2022] GET /compute/v2.1/servers/18aa3b17-222c-4330-a1fd-72ee1a96c82e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:33:55.550689 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:55.556594 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:55.567357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.569619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.570663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.572127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.573643 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.574577 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.630533 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-2ba7d910-afe4-412a-8a8c-02c6991b42cb tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.088197 Aug 24 11:33:55.636826 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 523/1068] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:55 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:55.791161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:55.792128 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:55.819139 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.820525 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.822667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.824284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.826639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.827650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.902175 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-90663ed3-494b-4d8c-af82-3ef10f4513e1 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9" status: 200 len: 194 microversion: 2.1 time: 0.119142 Aug 24 11:33:55.914579 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 546/1069] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 24 11:33:55 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9 => generated 194 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:55.920902 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:55.922226 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:55.934238 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.934749 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.935234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:55.946470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:55.946470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:55.946880 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:56.139266 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lazy-loading 'services' on Instance uuid 2e7f5ac0-3211-4d69-bcec-99f90bab124c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:56.337848 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ebe03750-529b-458c-bcef-03e65ac4eb6a tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9" status: 202 len: 0 microversion: 2.1 time: 0.422642 Aug 24 11:33:56.338616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 524/1070] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:55 2022] DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/1a2bb8a0-6215-4059-aefa-c5ecf5bad6d9 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:33:59.888603 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:59.889400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:59.897821 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:59.899162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:59.900010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:59.902162 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:59.903067 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:59.905860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:59.973870 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e39f2e31-439c-4736-ad81-b81f02fc620c tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/8502db0e-c973-4c7a-b949-197fdf9005fc" status: 200 len: 194 microversion: 2.1 time: 0.089993 Aug 24 11:33:59.980763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 547/1071] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 24 11:33:59 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/8502db0e-c973-4c7a-b949-197fdf9005fc => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:59.986537 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:59.987855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:00.000116 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:00.001429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:00.002320 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:00.003753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:00.005766 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:00.007225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:00.168057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lazy-loading 'services' on Instance uuid 2e7f5ac0-3211-4d69-bcec-99f90bab124c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:34:00.332735 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-6f19b9b6-7185-475c-a2d0-10aa138f45c5 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/8502db0e-c973-4c7a-b949-197fdf9005fc" status: 202 len: 0 microversion: 2.1 time: 0.351159 Aug 24 11:34:00.338118 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 525/1072] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:59 2022] DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments/8502db0e-c973-4c7a-b949-197fdf9005fc => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:34:01.719582 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:01.721951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:01.737071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.738008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.738457 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.739277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.739865 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.740364 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.781311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.792271 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-76a530f6-fb21-4d8e-9c4a-4179b8076b3d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077308 Aug 24 11:34:01.793111 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 548/1073] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:34:01 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:34:01.965586 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:01.971198 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:01.983400 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.984730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.985912 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.987223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.987898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.988563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.031211 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84976ab9-2a4b-4c37-97b3-7b4c9b5419da tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072573 Aug 24 11:34:02.032002 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 526/1074] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 24 11:34:01 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:34:02.136191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:02.136763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:02.151537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.152720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.154683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.156633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.157353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.158992 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.202680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:34:02.378070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-877b6449-90e1-40fa-90d1-a31199ca5613 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 204 len: 0 microversion: 2.1 time: 0.246477 Aug 24 11:34:02.379605 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 549/1075] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:34:02 2022] DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:34:02.393234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:02.394313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:02.415989 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.417764 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.421865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.423224 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.424364 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.424850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.631863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:02.647227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-423734aa-c0dc-41e0-9c60-b846a299115d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1671 microversion: 2.1 time: 0.261094 Aug 24 11:34:02.648316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 527/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:02 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:03.671311 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:03.672095 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:03.679338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:03.679976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:03.680764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:03.682060 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:03.682993 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:03.683862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:03.957189 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:03.980026 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dad0cb6e-af84-4f40-9c7c-17813b4b8fb4 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1671 microversion: 2.1 time: 0.313903 Aug 24 11:34:03.981887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 550/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:03 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:04.602833 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a6da4a87-8364-42ae-8efe-0b34aabdf65f tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4be44c0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:04.687145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a6da4a87-8364-42ae-8efe-0b34aabdf65f tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8db8e4ad-a383-4671-a72e-fefa0ec9c67e" status: 200 len: 349 microversion: 2.1 time: 0.089196 Aug 24 11:34:04.688361 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 528/1078] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:04 2022] GET /compute/v2.1/os-volumes/8db8e4ad-a383-4671-a72e-fefa0ec9c67e => generated 349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:05.016664 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:05.018049 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:05.027914 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:05.030649 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:05.031440 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:05.032662 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:05.033461 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:05.034146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:05.398751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:05.428999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c53130d-1e35-4e61-9124-f8cf2b21e921 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1671 microversion: 2.1 time: 0.418204 Aug 24 11:34:05.431704 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 551/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:05 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1671 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:06.459795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:06.460906 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:06.473750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=42 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.500248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:06.500248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:06.500248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:06.500248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:06.500629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:06.500629 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:06.581040 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c2343cf2-45c7-4116-aa87-227206f2b5f0 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba48b83a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:06.744174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c2343cf2-45c7-4116-aa87-227206f2b5f0 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ad78b6dd-6e01-4147-9596-a5e0dad5f4f3" status: 200 len: 351 microversion: 2.1 time: 0.167255 Aug 24 11:34:06.744931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 552/1080] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:06 2022] GET /compute/v2.1/os-volumes/ad78b6dd-6e01-4147-9596-a5e0dad5f4f3 => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:06.805155 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:06.821457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-05dcd3dd-f40b-475d-b13d-5c8df0f78bca tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1603 microversion: 2.1 time: 0.366481 Aug 24 11:34:06.822632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 529/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:06 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1603 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:07.309015 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ca29be3b-47a3-4588-8255-ed39879e7119 req-267bb4b8-08d7-451b-818b-afcf5ebfc7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7f5ac0-3211-4d69-bcec-99f90bab124c", "name": "network-vif-deleted", "tag": "df280a3d-128e-49e9-95e6-48cbd65aff9d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:07.331843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ca29be3b-47a3-4588-8255-ed39879e7119 req-267bb4b8-08d7-451b-818b-afcf5ebfc7f8 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.332890 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ca29be3b-47a3-4588-8255-ed39879e7119 req-267bb4b8-08d7-451b-818b-afcf5ebfc7f8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.333924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ca29be3b-47a3-4588-8255-ed39879e7119 req-267bb4b8-08d7-451b-818b-afcf5ebfc7f8 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.359984 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ca29be3b-47a3-4588-8255-ed39879e7119 req-267bb4b8-08d7-451b-818b-afcf5ebfc7f8 service nova] Creating event network-vif-deleted:df280a3d-128e-49e9-95e6-48cbd65aff9d for instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c on hv-cinder-85427 Aug 24 11:34:07.376888 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ca29be3b-47a3-4588-8255-ed39879e7119 req-267bb4b8-08d7-451b-818b-afcf5ebfc7f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069836 Aug 24 11:34:07.384633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 553/1082] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:07.855726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:07.858079 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:07.874865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.877120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.880234 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.882595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.883333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.884960 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.928521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.929109 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.929770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.930435 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.objects.instance [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lazy-loading 'fault' on Instance uuid 2e7f5ac0-3211-4d69-bcec-99f90bab124c {{(pid=120722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:34:08.057619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a426581a984225a97d7f4d60380aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33444243cd2042d2aa895c226fa3fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:08.084694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4fbf0717-8a00-4719-9944-13e6faeb5920 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 200 len: 1326 microversion: 2.1 time: 0.231215 Aug 24 11:34:08.086133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 530/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:07 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 1326 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:08.756678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce5dc169-4fe3-4558-8ae2-8c3db9717625 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba491b670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:08.935332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce5dc169-4fe3-4558-8ae2-8c3db9717625 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a340d8c8-9fc8-47be-828e-3e71150daaf3" status: 200 len: 351 microversion: 2.1 time: 0.203074 Aug 24 11:34:08.936433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 554/1084] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:08 2022] GET /compute/v2.1/os-volumes/a340d8c8-9fc8-47be-828e-3e71150daaf3 => generated 351 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:08.949680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0bcf1ed4-f4b0-4139-aa4f-d149130f1ff0 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4a17ee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.109405 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.110291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:09.121891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.124966 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.126122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.127236 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:09.129976 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:09.130519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.155068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0bcf1ed4-f4b0-4139-aa4f-d149130f1ff0 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.209905 Aug 24 11:34:09.156225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 531/1085] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Aug 24 11:34:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:09.170528 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-182086e7-31a9-46f0-a9ba-b956395ab153 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4a89f70>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.197104 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] HTTP exception thrown: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Request method failure captured: Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c HTTP/1.1 Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgs2COeG8eXxQ9LVwww2KUiNzcELvu0BMj2Qkrx5DFQ9-pufhhTXgVDGd13VJlBwONMDmN5pUWMZiRY8QztI4bIYzyCayXchNXwvnKRhE6KJGWzSSvqIyG8RAqujg9qjIvKwrvfU3aysTLsyB9HjmLftB0iR3_JNrc18LZuZBofoK8o Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:09.204746 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 91a426581a984225a97d7f4d60380aba Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:09.206359 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '2e7f5ac0-3211-4d69-bcec-99f90bab124c'} Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:09.207154 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:09.208467 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:09.212374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Returning 404 to user: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:09.214086 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15e4c5f0-9ca0-4a11-bbc0-7c98ae5e6c2d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 404 len: 111 microversion: 2.1 time: 0.109168 Aug 24 11:34:09.215850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 555/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:34:09.227114 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-438a7c5e-4d72-4d2e-8156-b09387d4594d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '.version_select at 0x7f5ba48b85e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.261148 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-438a7c5e-4d72-4d2e-8156-b09387d4594d tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921109006" status: 202 len: 0 microversion: 2.1 time: 0.037178 Aug 24 11:34:09.262113 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 556/1087] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 24 11:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921109006 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:34:09.351950 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-182086e7-31a9-46f0-a9ba-b956395ab153 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.185597 Aug 24 11:34:09.353067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 532/1088] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:09.369394 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32cdaf51-2e5d-4105-9558-51454a00218a tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4766040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.511624 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32cdaf51-2e5d-4105-9558-51454a00218a tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.147471 Aug 24 11:34:09.521414 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 557/1089] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:09.529289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0c42aed6-c92c-4d0a-8377-5c2895969655 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba482e040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.713306 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0c42aed6-c92c-4d0a-8377-5c2895969655 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.190798 Aug 24 11:34:09.728271 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 533/1090] 10.222.0.17 () {58 vars in 1167 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:09.730259 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41656ffd-784b-4854-bc60-54a531a1e37b tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4766ee0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:09.895516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41656ffd-784b-4854-bc60-54a531a1e37b tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.171174 Aug 24 11:34:09.898452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 558/1091] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:09.913539 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-62257519-9c09-4fb0-81da-664cd6ee26cb tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4accdc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:10.068893 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-62257519-9c09-4fb0-81da-664cd6ee26cb tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.160573 Aug 24 11:34:10.069753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 534/1092] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Aug 24 11:34:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:10.086126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bfe7399-c9da-463d-aa43-c539f55c4792 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba491e040>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:10.419897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8bfe7399-c9da-463d-aa43-c539f55c4792 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.339802 Aug 24 11:34:10.420562 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 559/1093] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Aug 24 11:34:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:10.443098 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b426c744-1083-44e8-b132-b9eb311fd5e9 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] Calling method '.version_select at 0x7f5ba4a3b040>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:10.647170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b426c744-1083-44e8-b132-b9eb311fd5e9 tempest-VolumesTestJSON-260970403 tempest-VolumesTestJSON-260970403-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.214593 Aug 24 11:34:10.648143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 535/1094] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Aug 24 11:34:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:13.664146 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.664902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:13.677786 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.679430 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.682088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.683538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.685857 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.697963 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.737372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] HTTP exception thrown: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Request method failure captured: Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c HTTP/1.1 Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgs2COeG8eXxQ9LVwww2KUiNzcELvu0BMj2Qkrx5DFQ9-pufhhTXgVDGd13VJlBwONMDmN5pUWMZiRY8QztI4bIYzyCayXchNXwvnKRhE6KJGWzSSvqIyG8RAqujg9qjIvKwrvfU3aysTLsyB9HjmLftB0iR3_JNrc18LZuZBofoK8o Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:13.740275 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 91a426581a984225a97d7f4d60380aba Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.742285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '2e7f5ac0-3211-4d69-bcec-99f90bab124c'} Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:13.743243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.744721 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.748954 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Returning 404 to user: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:13.758779 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30725d8d-1403-4333-8cfb-62b34c292695 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 404 len: 111 microversion: 2.1 time: 0.092458 Aug 24 11:34:13.761312 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 560/1095] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:34:13 2022] DELETE /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:13.773875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.775647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 2e7f5ac0-3211-4d69-bcec-99f90bab124c] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:13.786874 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.787676 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.787814 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.788475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.789230 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.789832 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.819962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] HTTP exception thrown: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Request method failure captured: Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c HTTP/1.1 Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgs2COeG8eXxQ9LVwww2KUiNzcELvu0BMj2Qkrx5DFQ9-pufhhTXgVDGd13VJlBwONMDmN5pUWMZiRY8QztI4bIYzyCayXchNXwvnKRhE6KJGWzSSvqIyG8RAqujg9qjIvKwrvfU3aysTLsyB9HjmLftB0iR3_JNrc18LZuZBofoK8o Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:13.824068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 91a426581a984225a97d7f4d60380aba Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.826599 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '2e7f5ac0-3211-4d69-bcec-99f90bab124c'} Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:13.827566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. Aug 24 11:34:13.829353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:13.831225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Returning 404 to user: Instance 2e7f5ac0-3211-4d69-bcec-99f90bab124c could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:13.832717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15eca4e5-f5b2-4e91-9c4c-aa619eb4d711 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c" status: 404 len: 111 microversion: 2.1 time: 0.064584 Aug 24 11:34:13.836997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 536/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:13 2022] GET /compute/v2.1/servers/2e7f5ac0-3211-4d69-bcec-99f90bab124c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:15.237590 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:15.238986 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:15.262284 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.268970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.273038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.276816 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.277514 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.278715 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.322587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] HTTP exception thrown: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Request method failure captured: Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 HTTP/1.1 Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgs2COeG8eXxQ9LVwww2KUiNzcELvu0BMj2Qkrx5DFQ9-pufhhTXgVDGd13VJlBwONMDmN5pUWMZiRY8QztI4bIYzyCayXchNXwvnKRhE6KJGWzSSvqIyG8RAqujg9qjIvKwrvfU3aysTLsyB9HjmLftB0iR3_JNrc18LZuZBofoK8o Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:15.330982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 91a426581a984225a97d7f4d60380aba Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.333549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '040f5a2c-3c12-4b35-bdc5-91a6d497c066'} Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:15.334999 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.338160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.340778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Returning 404 to user: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:15.340778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-01a27a6f-6f32-4c2a-be4f-3a225633dc34 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 404 len: 111 microversion: 2.1 time: 0.099435 Aug 24 11:34:15.340778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 561/1097] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:34:15 2022] DELETE /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:15.349475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:15.349475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] [instance: 040f5a2c-3c12-4b35-bdc5-91a6d497c066] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:15.372480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.373538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.384753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.385680 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.386304 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.386672 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.448301 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] HTTP exception thrown: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Request method failure captured: Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 HTTP/1.1 Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgs2COeG8eXxQ9LVwww2KUiNzcELvu0BMj2Qkrx5DFQ9-pufhhTXgVDGd13VJlBwONMDmN5pUWMZiRY8QztI4bIYzyCayXchNXwvnKRhE6KJGWzSSvqIyG8RAqujg9qjIvKwrvfU3aysTLsyB9HjmLftB0iR3_JNrc18LZuZBofoK8o Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:15.449951 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33444243cd2042d2aa895c226fa3fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 33444243cd2042d2aa895c226fa3fc3b Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2060072657 Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 91a426581a984225a97d7f4d60380aba Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-AttachVolumeTestJSON-2060072657-project Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.452817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '040f5a2c-3c12-4b35-bdc5-91a6d497c066'} Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:15.453885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. Aug 24 11:34:15.455647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:15.468981 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] Returning 404 to user: Instance 040f5a2c-3c12-4b35-bdc5-91a6d497c066 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:15.472139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3cc1ebe7-d0e9-4380-b985-498b240ea250 tempest-AttachVolumeTestJSON-2060072657 tempest-AttachVolumeTestJSON-2060072657-project] 10.222.0.17 "GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066" status: 404 len: 111 microversion: 2.1 time: 0.130853 Aug 24 11:34:15.472139 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 537/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:15 2022] GET /compute/v2.1/servers/040f5a2c-3c12-4b35-bdc5-91a6d497c066 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:19.110338 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-280f6654-8be6-4611-a4fc-9c2de1615c01 tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Action: 'create', calling method: .version_select at 0x7f5ba491e430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1754999421", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-280f6654-8be6-4611-a4fc-9c2de1615c01 tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Request method failure captured: Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 122 Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgy6GAetJf8bkcYWkTtjeiKGCNHurhhnaWU0rHy48yE0VCAO0C4dJ7lf6AKY_2dy4tDcn01HMnlFIoWQdg4jDF1ozUNTxTZI7iHRl6jhuJPGu-t1uYR5yurHVlPT9X9e_domACivHY-roOnV_-PyKsft4lqf_nRPjXCF2f5Ent4qjJI Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:19.126912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 5df8276d0bd040578c68220eef181fc2 Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1754999421", "metadata": {"Type": "work"}}} Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: Aug 24 11:34:19.128587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1754999421', 'metadata': {'Type': 'work'}}}} Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:19.129549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:34:19.132491 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:34:19.136519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:34:19.136519 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.139683 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-280f6654-8be6-4611-a4fc-9c2de1615c01 tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:19.141831 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-280f6654-8be6-4611-a4fc-9c2de1615c01 tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.441990 Aug 24 11:34:19.143020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 562/1099] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 11:34:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 11:34:19.157497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adaa8209-97a3-453d-a35e-69049fb717ae tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Action: 'create', calling method: .version_select at 0x7f5ba4a3bf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1842344964", "metadata": {"Type": "work"}}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adaa8209-97a3-453d-a35e-69049fb717ae tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Request method failure captured: Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 120 Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgy6GAetJf8bkcYWkTtjeiKGCNHurhhnaWU0rHy48yE0VCAO0C4dJ7lf6AKY_2dy4tDcn01HMnlFIoWQdg4jDF1ozUNTxTZI7iHRl6jhuJPGu-t1uYR5yurHVlPT9X9e_domACivHY-roOnV_-PyKsft4lqf_nRPjXCF2f5Ent4qjJI Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:19.167072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 5df8276d0bd040578c68220eef181fc2 Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1842344964", "metadata": {"Type": "work"}}} Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: Aug 24 11:34:19.169055 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1842344964', 'metadata': {'Type': 'work'}}}} Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi '0' Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:19.170338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:34:19.174926 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:34:19.178560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:34:19.178560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.180566 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-adaa8209-97a3-453d-a35e-69049fb717ae tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:19.181794 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-adaa8209-97a3-453d-a35e-69049fb717ae tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032979 Aug 24 11:34:19.182928 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 538/1100] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 11:34:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:34:19.193313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eed123fd-e161-4445-9ba7-7532ba14471d tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Action: 'create', calling method: .version_select at 0x7f5ba4865160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-407395467", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eed123fd-e161-4445-9ba7-7532ba14471d tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Request method failure captured: Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 118 Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgy6GAetJf8bkcYWkTtjeiKGCNHurhhnaWU0rHy48yE0VCAO0C4dJ7lf6AKY_2dy4tDcn01HMnlFIoWQdg4jDF1ozUNTxTZI7iHRl6jhuJPGu-t1uYR5yurHVlPT9X9e_domACivHY-roOnV_-PyKsft4lqf_nRPjXCF2f5Ent4qjJI Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:19.199070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 5df8276d0bd040578c68220eef181fc2 Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-407395467", "metadata": {"Type": "work"}}} Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: Aug 24 11:34:19.202451 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-407395467', 'metadata': {'Type': 'work'}}}} Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi '' Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:19.203907 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:34:19.206166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:34:19.208051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:34:19.208051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.208051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eed123fd-e161-4445-9ba7-7532ba14471d tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:19.208051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eed123fd-e161-4445-9ba7-7532ba14471d tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012531 Aug 24 11:34:19.208051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 563/1101] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 11:34:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:34:19.212428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8020a929-3aef-4d6c-8852-e522784ab1bf tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Calling method '.version_select at 0x7f5ba4a171f0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:19.298199 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-8020a929-3aef-4d6c-8852-e522784ab1bf tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] HTTP exception thrown: Volume tempest-invalid-1418671750 could not be found. Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8020a929-3aef-4d6c-8852-e522784ab1bf tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Request method failure captured: Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1418671750 HTTP/1.1 Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgy6GAetJf8bkcYWkTtjeiKGCNHurhhnaWU0rHy48yE0VCAO0C4dJ7lf6AKY_2dy4tDcn01HMnlFIoWQdg4jDF1ozUNTxTZI7iHRl6jhuJPGu-t1uYR5yurHVlPT9X9e_domACivHY-roOnV_-PyKsft4lqf_nRPjXCF2f5Ent4qjJI Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:19.302310 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 5df8276d0bd040578c68220eef181fc2 Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Volume tempest-invalid-1418671750 could not be found. Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'tempest-invalid-1418671750'} Aug 24 11:34:19.304441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1418671750 could not be found. (HTTP 404) (Request-ID: req-15c44e09-955d-4ee5-8de5-495f3a982503) Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.305969 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:34:19.307930 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1418671750 could not be found. Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:19.311093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1418671750 could not be found. Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1418671750 could not be found. Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8020a929-3aef-4d6c-8852-e522784ab1bf tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Returning 404 to user: Volume tempest-invalid-1418671750 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8020a929-3aef-4d6c-8852-e522784ab1bf tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1418671750" status: 404 len: 99 microversion: 2.1 time: 0.096594 Aug 24 11:34:19.314829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 539/1102] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 24 11:34:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1418671750 => generated 99 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:34:19.316100 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e095113-abbc-44f0-8089-d2fddc4a831b tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004757 Aug 24 11:34:19.316827 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 564/1103] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Aug 24 11:34:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:34:19.332066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f3086ffc-d434-486c-bdcb-5793ca782155 tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010363 Aug 24 11:34:19.332895 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 540/1104] 10.222.0.17 () {58 vars in 1137 bytes} [Wed Aug 24 11:34:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:34:19.345384 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5dad4d96-0a1c-445f-83fd-aaafe99a73ef tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Calling method '.version_select at 0x7f5ba48d7f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:19.394526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-5dad4d96-0a1c-445f-83fd-aaafe99a73ef tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] HTTP exception thrown: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5dad4d96-0a1c-445f-83fd-aaafe99a73ef tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Request method failure captured: Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/c8244d29-8957-4c5e-a832-889587cbf0aa HTTP/1.1 Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgy6GAetJf8bkcYWkTtjeiKGCNHurhhnaWU0rHy48yE0VCAO0C4dJ7lf6AKY_2dy4tDcn01HMnlFIoWQdg4jDF1ozUNTxTZI7iHRl6jhuJPGu-t1uYR5yurHVlPT9X9e_domACivHY-roOnV_-PyKsft4lqf_nRPjXCF2f5Ent4qjJI Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:19.400008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: 5df8276d0bd040578c68220eef181fc2 Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'c8244d29-8957-4c5e-a832-889587cbf0aa'} Aug 24 11:34:19.402136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. (HTTP 404) (Request-ID: req-ab75c59a-98ee-47af-9548-ab8fbc0d0762) Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.405038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:34:19.406722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:34:19.408437 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5dad4d96-0a1c-445f-83fd-aaafe99a73ef tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Returning 404 to user: Volume c8244d29-8957-4c5e-a832-889587cbf0aa could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5dad4d96-0a1c-445f-83fd-aaafe99a73ef tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/c8244d29-8957-4c5e-a832-889587cbf0aa" status: 404 len: 109 microversion: 2.1 time: 0.068233 Aug 24 11:34:19.412667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 565/1105] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:34:19 2022] DELETE /compute/v2.1/os-volumes/c8244d29-8957-4c5e-a832-889587cbf0aa => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:19.438309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d17c538-e584-4ab9-b1db-c5dc2ce5008f tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Calling method '.version_select at 0x7f5ba472baf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:19.482927 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-1d17c538-e584-4ab9-b1db-c5dc2ce5008f tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] HTTP exception thrown: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d17c538-e584-4ab9-b1db-c5dc2ce5008f tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Request method failure captured: Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/os-volumes/d0f8c212-968b-487b-be41-79fcd08d7fe9 HTTP/1.1 Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgy6GAetJf8bkcYWkTtjeiKGCNHurhhnaWU0rHy48yE0VCAO0C4dJ7lf6AKY_2dy4tDcn01HMnlFIoWQdg4jDF1ozUNTxTZI7iHRl6jhuJPGu-t1uYR5yurHVlPT9X9e_domACivHY-roOnV_-PyKsft4lqf_nRPjXCF2f5Ent4qjJI Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:19.485781 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ed1e7bb2d2942589c07c179556c5c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 1ed1e7bb2d2942589c07c179556c5c0b Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesNegativeTest-596058973 Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: 5df8276d0bd040578c68220eef181fc2 Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesNegativeTest-596058973-project Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': 'd0f8c212-968b-487b-be41-79fcd08d7fe9'} Aug 24 11:34:19.488151 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. (HTTP 404) (Request-ID: req-50122f55-2e39-4c31-ac8d-24826275e01d) Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.489885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:19.491719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:34:19.494023 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. Aug 24 11:34:19.498731 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:19.505865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1d17c538-e584-4ab9-b1db-c5dc2ce5008f tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] Returning 404 to user: Volume d0f8c212-968b-487b-be41-79fcd08d7fe9 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:19.507647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1d17c538-e584-4ab9-b1db-c5dc2ce5008f tempest-VolumesNegativeTest-596058973 tempest-VolumesNegativeTest-596058973-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d0f8c212-968b-487b-be41-79fcd08d7fe9" status: 404 len: 109 microversion: 2.1 time: 0.084147 Aug 24 11:34:19.510453 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 541/1106] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:19 2022] GET /compute/v2.1/os-volumes/d0f8c212-968b-487b-be41-79fcd08d7fe9 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:25.239251 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6148b152-5929-4990-afb8-ffc48633bd18 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Action: 'create', calling method: .version_select at 0x7f5ba491e3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1340289180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVe+dkamUIEYsk43d4IjTW2DvnsTURhYS8e8DTa/zi+FiSdMUTejaufn0kxEAIot8YcsxVRsVTTBd/bLV1iKPXV5Sm7ngyyDJccYjJrVI8DybeVdCC5JAxYVDsOg1Qc7g=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:25.244712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.279171 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-6148b152-5929-4990-afb8-ffc48633bd18 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Getting quotas for project 8715407500f24272b8f4a16d3e2598c4. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:25.291766 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-6148b152-5929-4990-afb8-ffc48633bd18 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Getting quotas for user a7fd2ffa2af3401f84c07b5b6015e75a and project 8715407500f24272b8f4a16d3e2598c4. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:25.303970 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:25.335106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6148b152-5929-4990-afb8-ffc48633bd18 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.707338 Aug 24 11:34:25.336352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 566/1107] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 24 11:34:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:28.298856 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=9 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:28.301133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:28.659741 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-55f34d5e-05d0-4b08-8718-69b63adb0f4d tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Action: 'create', calling method: .version_select at 0x7f5ba472b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-388865039"}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:29.314157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-55f34d5e-05d0-4b08-8718-69b63adb0f4d tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.018615 Aug 24 11:34:29.315117 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 542/1108] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Aug 24 11:34:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1022 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 11:34:29.327957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91214ea2-7035-47f5-8f13-499cee820eef tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4a11280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:29.422789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91214ea2-7035-47f5-8f13-499cee820eef tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 200 len: 344 microversion: 2.1 time: 0.099217 Aug 24 11:34:29.429701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 567/1109] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:29 2022] GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:30.439174 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b99b7b9c-6ada-477e-a88c-7c1fa16d60d0 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48cfe50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:30.553706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b99b7b9c-6ada-477e-a88c-7c1fa16d60d0 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 200 len: 345 microversion: 2.1 time: 0.119541 Aug 24 11:34:30.554982 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 543/1110] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:30 2022] GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:30.568581 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cebfe9c9-b367-4765-bdb7-917a9b1f4bec tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Action: 'create', calling method: .version_select at 0x7f5ba8fedee0>, body: {"snapshot": {"volume_id": "000368ab-f2ba-4cc9-b6e2-7fa198bdc321", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-330160478"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:30.931087 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cebfe9c9-b367-4765-bdb7-917a9b1f4bec tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.366994 Aug 24 11:34:30.932281 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 568/1111] 10.222.0.17 () {60 vars in 1162 bytes} [Wed Aug 24 11:34:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:30.943442 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-daf22ad8-e4ee-4faa-909e-ab9dd990a536 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48cf160>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.012688 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-daf22ad8-e4ee-4faa-909e-ab9dd990a536 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.072634 Aug 24 11:34:31.014091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 544/1112] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:30 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:31.029443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d1e073c-840b-4ccc-9f5f-5d9088ebbf74 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba8fed700>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.086172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d1e073c-840b-4ccc-9f5f-5d9088ebbf74 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.062224 Aug 24 11:34:31.087132 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 569/1113] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Aug 24 11:34:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:31.097655 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-1daad3d5-f41b-47fb-9929-1ace03ec7508 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48cfa60>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.144557 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-1daad3d5-f41b-47fb-9929-1ace03ec7508 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.050699 Aug 24 11:34:31.145511 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 545/1114] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:31 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:32.158785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec6220aa-bc18-4cea-b1d2-7f2082550154 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4766820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:32.196278 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec6220aa-bc18-4cea-b1d2-7f2082550154 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.041795 Aug 24 11:34:32.197409 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 570/1115] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:32 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:33.221350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-84358d53-4727-4e1e-9983-4a49945d2062 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba482ec10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:33.258942 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-84358d53-4727-4e1e-9983-4a49945d2062 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.049982 Aug 24 11:34:33.260632 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 546/1116] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:33 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:34.274592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7734280-90be-4f6c-b375-013e99f4e0e3 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4825b80>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:34.316516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7734280-90be-4f6c-b375-013e99f4e0e3 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.047749 Aug 24 11:34:34.317663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 571/1117] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:34 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:35.331727 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-82e2d93a-1f31-4a16-a56a-7ce959b27dce tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba472baf0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:35.367208 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-82e2d93a-1f31-4a16-a56a-7ce959b27dce tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.041051 Aug 24 11:34:35.369411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 547/1118] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:35 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:36.387918 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee1f683a-7418-46ac-9c5e-2b4dac1e8921 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4766820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:36.394506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:36.395596 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:36.434748 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee1f683a-7418-46ac-9c5e-2b4dac1e8921 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.050565 Aug 24 11:34:36.435707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 572/1119] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:36 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:37.449015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-38f14a97-db8e-41e0-a727-534a096f7f54 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4c08700>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:37.489165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-38f14a97-db8e-41e0-a727-534a096f7f54 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 287 microversion: 2.1 time: 0.044064 Aug 24 11:34:37.490233 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 548/1120] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:37 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:37.504734 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb52e0e7-c259-42e8-ba12-44ae48481245 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4a114c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:37.585479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb52e0e7-c259-42e8-ba12-44ae48481245 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 202 len: 0 microversion: 2.1 time: 0.086867 Aug 24 11:34:37.586448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 573/1121] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Aug 24 11:34:37 2022] DELETE /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:37.597545 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0b145273-1e34-491c-a36c-be6a3b346103 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48cf9d0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:37.663677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0b145273-1e34-491c-a36c-be6a3b346103 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 200 len: 286 microversion: 2.1 time: 0.070785 Aug 24 11:34:37.664610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 549/1122] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:37 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:38.684923 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a52a33cc-6b83-4a2a-b401-741a2b097401 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba8fed550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:38.712764 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a52a33cc-6b83-4a2a-b401-741a2b097401 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] HTTP exception thrown: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a52a33cc-6b83-4a2a-b401-741a2b097401 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Request method failure captured: Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd HTTP/1.1 Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgzEeveCT7K4oN_57xoyJ-bZTOgkEc2CrnPDbcjE4flOQ5DNFJHsAIkcI5hiE1Aoye8K299KHiH3SKYfBy9bdjzeCNdQwBj04q5zbnKX90AbnGPYIZGku7TJYdkT4mYjlz2BijywUlpffq59G3-DiyczvRitwpBtvVdjKI8OV3f_u6I Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:38.715650 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: ebd2f3221f8e4c75a607b88abc5cab89 Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd'} Aug 24 11:34:38.717351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. (HTTP 404) (Request-ID: req-d8495c77-6d34-4635-b025-1e48c4b50ad4) Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.718208 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:38.720657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 11:34:38.722475 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a52a33cc-6b83-4a2a-b401-741a2b097401 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Returning 404 to user: Snapshot a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:38.726478 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a52a33cc-6b83-4a2a-b401-741a2b097401 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd" status: 404 len: 111 microversion: 2.1 time: 0.036441 Aug 24 11:34:38.729256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 574/1123] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:38 2022] GET /compute/v2.1/os-snapshots/a4f28601-e31b-4ce5-b1cc-f13b7fc1d6bd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:38.730506 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-0dd7456d-0f23-4a42-a545-838a50a02a5b tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba4accb80>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:38.814682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-0dd7456d-0f23-4a42-a545-838a50a02a5b tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 202 len: 0 microversion: 2.1 time: 0.092227 Aug 24 11:34:38.815538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 550/1124] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:34:38 2022] DELETE /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:34:38.827352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7121897d-e3d4-48a9-b11b-3305f6c440d3 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48e9a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:38.895332 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7121897d-e3d4-48a9-b11b-3305f6c440d3 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 200 len: 344 microversion: 2.1 time: 0.074923 Aug 24 11:34:38.895905 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 575/1125] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:38 2022] GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:39.912373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8d14e47-0bcb-41dd-8962-0ddfeb6a98cb tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48cfdc0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:39.952270 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e8d14e47-0bcb-41dd-8962-0ddfeb6a98cb tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] HTTP exception thrown: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8d14e47-0bcb-41dd-8962-0ddfeb6a98cb tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Request method failure captured: Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 HTTP/1.1 Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgzEeveCT7K4oN_57xoyJ-bZTOgkEc2CrnPDbcjE4flOQ5DNFJHsAIkcI5hiE1Aoye8K299KHiH3SKYfBy9bdjzeCNdQwBj04q5zbnKX90AbnGPYIZGku7TJYdkT4mYjlz2BijywUlpffq59G3-DiyczvRitwpBtvVdjKI8OV3f_u6I Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:39.956294 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: ebd2f3221f8e4c75a607b88abc5cab89 Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '000368ab-f2ba-4cc9-b6e2-7fa198bdc321'} Aug 24 11:34:39.958883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. (HTTP 404) (Request-ID: req-26605c2e-6681-49e6-8813-025c20cdcbf9) Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:39.960383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:39.963695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:34:39.968723 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e8d14e47-0bcb-41dd-8962-0ddfeb6a98cb tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Returning 404 to user: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e8d14e47-0bcb-41dd-8962-0ddfeb6a98cb tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 404 len: 109 microversion: 2.1 time: 0.052350 Aug 24 11:34:39.971987 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 551/1126] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:39 2022] GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:39.980785 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d60814ed-4bba-4e05-b850-4dcc20e58c38 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba8fe0430>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:40.034042 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-d60814ed-4bba-4e05-b850-4dcc20e58c38 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] HTTP exception thrown: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d60814ed-4bba-4e05-b850-4dcc20e58c38 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Request method failure captured: Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 HTTP/1.1 Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgzEeveCT7K4oN_57xoyJ-bZTOgkEc2CrnPDbcjE4flOQ5DNFJHsAIkcI5hiE1Aoye8K299KHiH3SKYfBy9bdjzeCNdQwBj04q5zbnKX90AbnGPYIZGku7TJYdkT4mYjlz2BijywUlpffq59G3-DiyczvRitwpBtvVdjKI8OV3f_u6I Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:40.036896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: ebd2f3221f8e4c75a607b88abc5cab89 Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '000368ab-f2ba-4cc9-b6e2-7fa198bdc321'} Aug 24 11:34:40.039583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. (HTTP 404) (Request-ID: req-d33db695-3a28-412d-a8bb-749a3507d596) Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:40.041264 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:34:40.044688 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:34:40.048354 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d60814ed-4bba-4e05-b850-4dcc20e58c38 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Returning 404 to user: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:40.052035 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d60814ed-4bba-4e05-b850-4dcc20e58c38 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 404 len: 109 microversion: 2.1 time: 0.063795 Aug 24 11:34:40.054818 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 576/1127] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:34:39 2022] DELETE /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:40.057316 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c96d19bf-45d7-4822-8e6a-1927206e3986 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Calling method '.version_select at 0x7f5ba48c2430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:40.101035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-c96d19bf-45d7-4822-8e6a-1927206e3986 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] HTTP exception thrown: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c96d19bf-45d7-4822-8e6a-1927206e3986 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Request method failure captured: Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 HTTP/1.1 Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgzEeveCT7K4oN_57xoyJ-bZTOgkEc2CrnPDbcjE4flOQ5DNFJHsAIkcI5hiE1Aoye8K299KHiH3SKYfBy9bdjzeCNdQwBj04q5zbnKX90AbnGPYIZGku7TJYdkT4mYjlz2BijywUlpffq59G3-DiyczvRitwpBtvVdjKI8OV3f_u6I Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:34:40.103083 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b09820cc1ebe46bca7fdeb9ac5e97e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: b09820cc1ebe46bca7fdeb9ac5e97e2b Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1784858083 Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: ebd2f3221f8e4c75a607b88abc5cab89 Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1784858083-project Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '000368ab-f2ba-4cc9-b6e2-7fa198bdc321'} Aug 24 11:34:40.104485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. (HTTP 404) (Request-ID: req-ce874862-012d-495d-9281-97ab78968f18) Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:40.105380 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:40.107252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:34:40.108894 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c96d19bf-45d7-4822-8e6a-1927206e3986 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] Returning 404 to user: Volume 000368ab-f2ba-4cc9-b6e2-7fa198bdc321 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c96d19bf-45d7-4822-8e6a-1927206e3986 tempest-VolumesSnapshotsTestJSON-1784858083 tempest-VolumesSnapshotsTestJSON-1784858083-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321" status: 404 len: 109 microversion: 2.1 time: 0.055938 Aug 24 11:34:40.111889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 552/1128] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:40 2022] GET /compute/v2.1/os-volumes/000368ab-f2ba-4cc9-b6e2-7fa198bdc321 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:43.158349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12f8f97c-70b8-4572-a802-5ded65435f31 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Action: 'create', calling method: .version_select at 0x7f5ba8fed3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1004749330", "metadata": {"Type": "work"}}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:43.561695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12f8f97c-70b8-4572-a802-5ded65435f31 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.714701 Aug 24 11:34:43.563302 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 577/1129] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 24 11:34:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 716 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 11:34:43.577336 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-8c17eea8-07d8-4b68-b06e-fbee8720b154 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Calling method '.version_select at 0x7f5ba48cfee0>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:43.669865 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-8c17eea8-07d8-4b68-b06e-fbee8720b154 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4" status: 200 len: 353 microversion: 2.1 time: 0.098124 Aug 24 11:34:43.670696 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 553/1130] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:43 2022] GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:43.735653 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:34:43.735883 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Wed Aug 24 11:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:34:44.684981 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a49e54f8-50af-4df9-a454-74f281f2c63d tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Calling method '.version_select at 0x7f5ba483e160>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.734877 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a49e54f8-50af-4df9-a454-74f281f2c63d tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4" status: 200 len: 354 microversion: 2.1 time: 0.054792 Aug 24 11:34:44.735448 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 578/1131] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:44 2022] GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:44.749932 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ada3f1f0-3d27-4223-b882-8719b521517e tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Calling method '.version_select at 0x7f5ba4c08c10>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.801850 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ada3f1f0-3d27-4223-b882-8719b521517e tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4" status: 200 len: 354 microversion: 2.1 time: 0.057191 Aug 24 11:34:44.802433 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 554/1132] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:44 2022] GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:44.820088 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9bdaa00a-ecae-4701-9a4e-30a5cf74f906 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Calling method '.version_select at 0x7f5ba8fe0280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.895638 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9bdaa00a-ecae-4701-9a4e-30a5cf74f906 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4" status: 202 len: 0 microversion: 2.1 time: 0.079315 Aug 24 11:34:44.896203 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 579/1133] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 24 11:34:44 2022] DELETE /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:44.905429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-491531aa-5a3b-41e0-8d75-fa10d182571a tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Calling method '.version_select at 0x7f5ba4a64430>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.956412 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-491531aa-5a3b-41e0-8d75-fa10d182571a tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4" status: 200 len: 353 microversion: 2.1 time: 0.055859 Aug 24 11:34:44.957461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 555/1134] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:44 2022] GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:45.974935 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6375c48a-e400-4ee2-aa88-9e5b174afd80 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Calling method '.version_select at 0x7f5ba8fe0d30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6375c48a-e400-4ee2-aa88-9e5b174afd80 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] HTTP exception thrown: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6375c48a-e400-4ee2-aa88-9e5b174afd80 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Request method failure captured: Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 HTTP/1.1 Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBgzSc9KwAeluPD62adCSrOC2NqDgU632Z4jtcAozY6h2reONC45zEEwe09OmW_c1M_ItywOCwFxlyFq7FzHSNjjtqYvqX9pLxq54h6nXtz6SDR0-vUNY5kKNlFt2vcOdzL-HZ2ouTrKJr23HopDrlPMis5H6YUDsXcU_0AHs2Ht6D2U Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: 0874c5502714405f86ce3dd65373f681 Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesGetTestJSON-1000922439 Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:34:46.011326 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0874c5502714405f86ce3dd65373f681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0874c5502714405f86ce3dd65373f681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0874c5502714405f86ce3dd65373f681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0874c5502714405f86ce3dd65373f681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesGetTestJSON-1000922439 Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0874c5502714405f86ce3dd65373f681 Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesGetTestJSON-1000922439 Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesGetTestJSON-1000922439-project Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: f8c5334c1ddf4ee4add7cd2940bd5ad0 Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesGetTestJSON-1000922439-project Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '4e2473bb-5695-4918-9ae4-7874aa1838a4'} Aug 24 11:34:46.012789 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. (HTTP 404) (Request-ID: req-c88f1f86-68f2-4d91-a1b2-ce1e09aef03a) Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:46.014254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:34:46.015487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:34:46.016826 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6375c48a-e400-4ee2-aa88-9e5b174afd80 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] Returning 404 to user: Volume 4e2473bb-5695-4918-9ae4-7874aa1838a4 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6375c48a-e400-4ee2-aa88-9e5b174afd80 tempest-VolumesGetTestJSON-1000922439 tempest-VolumesGetTestJSON-1000922439-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4" status: 404 len: 109 microversion: 2.1 time: 0.039887 Aug 24 11:34:46.018895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 580/1135] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 24 11:34:45 2022] GET /compute/v2.1/os-volumes/4e2473bb-5695-4918-9ae4-7874aa1838a4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:51.587460 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1345728453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1340289180", "security_groups": [{"name": "tempest-secgroup-smoke-1356079129"}], "networks": [{"uuid": "8a740102-170e-44e3-9019-c8b85357d58d"}], "block_device_mapping_v2": [{"uuid": "dc068cc8-1d2f-4f0b-a76e-eb7f6c8165de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:51.774420 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.network.neutron [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] validate_networks() for [('8a740102-170e-44e3-9019-c8b85357d58d', None, None, None, None, None)] {{(pid=120722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:34:52.309448 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Flavor limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:34:52.309829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Image limits 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:34:52.310492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Flavor pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:34:52.310911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Image pref 0:0:0 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:34:52.311330 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.virt.hardware [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:34:52.328245 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:52.329025 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:52.329777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.330552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:52.331161 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:52.331587 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.367470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Getting quotas for project 8715407500f24272b8f4a16d3e2598c4. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:52.373803 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.quota [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Getting quotas for user a7fd2ffa2af3401f84c07b5b6015e75a and project 8715407500f24272b8f4a16d3e2598c4. Resources: {'cores', 'ram', 'instances'} {{(pid=120722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:52.476064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Going to run 1 instances... {{(pid=120722) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:34:52.478735 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc068cc8-1d2f-4f0b-a76e-eb7f6c8165de',volume_size=None,volume_type=None)] {{(pid=120722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:34:52.692890 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-facf659d-d761-41d5-b231-aa30fd165199 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.109774 Aug 24 11:34:52.700484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 556/1136] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:34:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:34:52.708068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-328b50ea-c7a8-43ea-a3d2-87c78f3577fe tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:52.710479 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-328b50ea-c7a8-43ea-a3d2-87c78f3577fe tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:52.814632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-328b50ea-c7a8-43ea-a3d2-87c78f3577fe tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:52.838053 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-328b50ea-c7a8-43ea-a3d2-87c78f3577fe tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1089 microversion: 2.1 time: 0.135557 Aug 24 11:34:52.839355 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 581/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:52 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1089 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:53.860904 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:53.862283 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:53.873715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.874461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.875158 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.876658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.877140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.877797 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.963761 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:53.974872 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-14b3cbac-e9bf-4e89-9977-e2115f0da376 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1131 microversion: 2.1 time: 0.116978 Aug 24 11:34:53.975474 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 557/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:53 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1131 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:54.996838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:54.997420 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:55.010526 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:55.011646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:55.012174 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:55.012883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:55.015481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:55.015860 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:55.090134 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:55.098941 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b285d2dc-fe43-4966-ae9f-2cfd9c6b8319 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1205 microversion: 2.1 time: 0.106411 Aug 24 11:34:55.099529 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 582/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:54 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1205 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:56.126132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:56.126689 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:56.134411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.134896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.135338 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.136621 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.138668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.142028 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.364628 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:56.380492 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-776d1a93-b22f-41b2-a81c-0d931c873002 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.257949 Aug 24 11:34:56.382038 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 558/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:56 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:57.034576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2d61e0e7-9f5e-46ed-8668-22441ff364e4 req-00300c73-27b1-40dd-b795-2d28f803027a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:57.061745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2d61e0e7-9f5e-46ed-8668-22441ff364e4 req-00300c73-27b1-40dd-b795-2d28f803027a service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.062674 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2d61e0e7-9f5e-46ed-8668-22441ff364e4 req-00300c73-27b1-40dd-b795-2d28f803027a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.063176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2d61e0e7-9f5e-46ed-8668-22441ff364e4 req-00300c73-27b1-40dd-b795-2d28f803027a service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.079931 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2d61e0e7-9f5e-46ed-8668-22441ff364e4 req-00300c73-27b1-40dd-b795-2d28f803027a service nova] Creating event network-changed:a1b7855f-6056-41a0-8e11-2db822f8d6be for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 on hv-cinder-85427 Aug 24 11:34:57.091751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2d61e0e7-9f5e-46ed-8668-22441ff364e4 req-00300c73-27b1-40dd-b795-2d28f803027a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078056 Aug 24 11:34:57.093090 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 583/1141] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:57.403631 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:57.404183 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:57.410707 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.411205 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.411644 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.412349 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.412799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.413491 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.646185 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:57.658371 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-15a10676-b4f0-4a7c-9bc7-7fc8e0ee985c tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.259114 Aug 24 11:34:57.659424 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 559/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:57 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:58.682353 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:58.683561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:58.691236 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.691997 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.692594 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.693313 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.693994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.694570 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.887712 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:58.895795 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de0cd1b7-a00f-43a5-919d-f30f59763d58 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.218214 Aug 24 11:34:58.896381 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 584/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:58 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:59.919642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:59.920258 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:59.926929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:59.927413 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:59.927875 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:59.928573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:59.929022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:59.929485 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:00.071946 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:00.079563 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-98b30ad8-7c54-4b4c-bbd7-77fa1cd1c6ac tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.164941 Aug 24 11:35:00.080124 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 560/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:59 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:01.100462 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:01.101081 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:01.107909 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:01.108396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:01.108828 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:01.109567 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:01.110020 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:01.110449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:01.302210 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:01.310413 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-32bb2f4c-0a6b-4edb-8db2-cf84cf542353 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.213724 Aug 24 11:35:01.310994 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 585/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:01 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:02.333929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:02.334720 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:02.342542 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:02.343035 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:02.343473 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:02.344183 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:02.344638 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:02.345060 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:02.349393 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:02.398339 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=6 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:02.502601 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:02.509937 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-766386cd-5819-4e18-87eb-fd558b1e4a4f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.180505 Aug 24 11:35:02.510576 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 561/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:02 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:03.530495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:03.531103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:03.533644 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:03.540718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:03.541243 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:03.541916 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:03.542671 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:03.543236 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:03.543880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:03.686320 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:03.694225 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6361ba0f-1950-4117-9d2b-a5947d7b85bd tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.168339 Aug 24 11:35:03.695069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 586/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:03 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:04.715331 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:04.715948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:04.722350 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:04.722830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:04.723263 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:04.723962 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:04.724412 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:04.724836 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:04.859082 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:04.866675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ca25ad16-650d-4dee-96b5-88fcd103dd98 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.155470 Aug 24 11:35:04.867248 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 562/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:04 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:05.890759 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:05.891830 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:05.902368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:05.902862 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:05.903288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:05.904008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:05.904637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:05.905058 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:06.088481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:06.099310 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9fc8d56-4791-45bf-a940-3ad7f8b743be tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.213847 Aug 24 11:35:06.101248 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 587/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:05 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:07.130750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:07.131715 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:07.139368 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:07.139972 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:07.140483 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:07.141342 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:07.142199 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:07.142719 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:07.381726 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:07.399907 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-021308f6-b8bd-4503-95cb-310f4e388d3d tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.281600 Aug 24 11:35:07.413251 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 563/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:07 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:08.424881 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:08.425944 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:08.434169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:08.434696 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:08.435561 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:08.436517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:08.437194 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:08.437727 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:08.633897 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:08.647032 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e5cf1ba-8351-419a-aebb-043f1dba1236 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.227942 Aug 24 11:35:08.647950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 588/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:08 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:09.668619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:09.670009 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:09.677716 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:09.678669 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:09.679352 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:09.682188 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:09.683275 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:09.683796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:09.832123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a920552e-3a8e-4542-a475-6dc9e5b32041 req-0ff976ad-2e61-44f6-8b54-8044882a0103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "name": "network-vif-plugged", "status": "completed", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:09.846788 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a920552e-3a8e-4542-a475-6dc9e5b32041 req-0ff976ad-2e61-44f6-8b54-8044882a0103 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:09.847555 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a920552e-3a8e-4542-a475-6dc9e5b32041 req-0ff976ad-2e61-44f6-8b54-8044882a0103 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:09.848407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a920552e-3a8e-4542-a475-6dc9e5b32041 req-0ff976ad-2e61-44f6-8b54-8044882a0103 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:09.860648 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:09.863415 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a920552e-3a8e-4542-a475-6dc9e5b32041 req-0ff976ad-2e61-44f6-8b54-8044882a0103 service nova] Creating event network-vif-plugged:a1b7855f-6056-41a0-8e11-2db822f8d6be for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 on hv-cinder-85427 Aug 24 11:35:09.869129 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a920552e-3a8e-4542-a475-6dc9e5b32041 req-0ff976ad-2e61-44f6-8b54-8044882a0103 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041851 Aug 24 11:35:09.870982 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-acf8a44f-37b3-4a49-be57-e2095eb1e5b1 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.206028 Aug 24 11:35:09.871260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 589/1152] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:09.872565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 564/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:09 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:10.478073 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1968525065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-564613301", "security_groups": [{"name": "tempest-secgroup-smoke-900977225"}], "block_device_mapping_v2": [{"uuid": "ae0f89bc-3d55-4237-8c52-ed916439498a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "76bed7fc-2ca1-4c54-8559-9ea4dba9aee6"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:10.610365 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] validate_networks() for [('76bed7fc-2ca1-4c54-8559-9ea4dba9aee6', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:35:10.897753 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:10.898370 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:10.905140 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:10.905644 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:10.906071 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:10.906767 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:10.907206 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:10.907619 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.050887 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:11.059019 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-540ba435-752d-4cf4-8525-6c30482b80a7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1261 microversion: 2.1 time: 0.165008 Aug 24 11:35:11.060578 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 565/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:10 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:11.144382 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:35:11.145092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:35:11.145951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:35:11.146687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:35:11.147400 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:35:11.162645 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.163495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.164259 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.165632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.166517 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.167668 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.196063 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for project e54623c55367410db8070615915e573e. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:35:11.201465 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Getting quotas for user cbeabb83431b4536b4c5fdf71e8a5a80 and project e54623c55367410db8070615915e573e. Resources: {'cores', 'ram', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:35:11.275639 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:35:11.278939 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae0f89bc-3d55-4237-8c52-ed916439498a',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:35:11.456098 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d6294df-7cbe-41ef-a327-e6f495e835f0 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.982733 Aug 24 11:35:11.457277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 590/1155] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 24 11:35:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:35:11.468721 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-83c901be-b94a-436f-a561-bc626826d973 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:11.469747 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-83c901be-b94a-436f-a561-bc626826d973 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:11.553768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-83c901be-b94a-436f-a561-bc626826d973 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:11.570012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-83c901be-b94a-436f-a561-bc626826d973 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1094 microversion: 2.1 time: 0.105078 Aug 24 11:35:11.571006 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 566/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:11 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:12.081341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:12.082199 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:12.090539 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.091024 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.091449 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.092151 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.092592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.093010 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.256487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:12.266926 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1144038-6953-4c33-887e-4d8cc5b1b908 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1446 microversion: 2.1 time: 0.190763 Aug 24 11:35:12.267490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 591/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:12 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:12.288193 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:12.290776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:12.296656 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.297146 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.297746 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.298411 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.299046 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.299357 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.436472 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:12.444548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-323c072f-5eb9-49f4-85d7-e0ecb6d6595e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1446 microversion: 2.1 time: 0.160417 Aug 24 11:35:12.445362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 567/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:12 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:12.594393 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:12.595178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:12.601221 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.601726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.602161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.603043 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:12.603496 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:12.603964 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:12.682537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:12.693560 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16e23ba2-2323-4401-a4d3-6af73a563987 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1192 microversion: 2.1 time: 0.103195 Aug 24 11:35:12.694112 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 592/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:12 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:13.725235 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:13.725665 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:13.733086 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:13.733603 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:13.734218 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:13.734976 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:13.735428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:13.735853 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:13.813423 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:13.827476 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c148221d-0df8-441c-95d6-60cb7a31dc65 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1192 microversion: 2.1 time: 0.106358 Aug 24 11:35:13.837700 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 568/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:13 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:14.564557 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ec11944b-e064-4eea-92a9-c7ac8cdd259c req-98f6a183-02e3-412b-9035-d527efbde120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:14.575470 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec11944b-e064-4eea-92a9-c7ac8cdd259c req-98f6a183-02e3-412b-9035-d527efbde120 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.575938 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec11944b-e064-4eea-92a9-c7ac8cdd259c req-98f6a183-02e3-412b-9035-d527efbde120 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.576362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ec11944b-e064-4eea-92a9-c7ac8cdd259c req-98f6a183-02e3-412b-9035-d527efbde120 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.588122 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ec11944b-e064-4eea-92a9-c7ac8cdd259c req-98f6a183-02e3-412b-9035-d527efbde120 service nova] Creating event network-changed:a1b7855f-6056-41a0-8e11-2db822f8d6be for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 on hv-cinder-85427 Aug 24 11:35:14.594638 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ec11944b-e064-4eea-92a9-c7ac8cdd259c req-98f6a183-02e3-412b-9035-d527efbde120 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033783 Aug 24 11:35:14.595238 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 593/1161] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:14.850573 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:14.851245 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:14.857607 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.858085 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.858513 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.859204 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:14.859647 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:14.860068 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.930241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:14.938187 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-ab9d5618-b6bc-4c6f-b973-79ffd338ada2 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1192 microversion: 2.1 time: 0.091639 Aug 24 11:35:14.938757 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 569/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:14 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:15.962001 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:15.963583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:15.983564 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:15.984074 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:15.984518 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:15.985261 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:15.985724 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:15.986152 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:16.055924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:16.065059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a38c06d0-d5a6-4124-9564-d564d402e464 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1210 microversion: 2.1 time: 0.108658 Aug 24 11:35:16.065676 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 594/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:15 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:17.086776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:17.087597 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:17.094922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:17.095401 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:17.095843 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:17.096550 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:17.096997 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:17.097450 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:17.242241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:17.250315 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-f13e867d-5728-4d05-912c-959b086a7e73 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.167397 Aug 24 11:35:17.251022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 570/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:17 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:18.273930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:18.274597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:18.281595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:18.282093 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:18.282536 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:18.283272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:18.283740 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:18.284169 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:18.430731 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:18.441047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e91d5eb-5731-4d58-bdff-5dc20c4afc6a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.170962 Aug 24 11:35:18.441695 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 595/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:18 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:19.470653 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:19.471333 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:19.478495 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:19.479008 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:19.479440 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:19.480145 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:19.480625 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:19.481018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:19.625679 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:19.633544 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cb030559-f27b-4b33-be42-d81d2ef5526b tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.166718 Aug 24 11:35:19.634108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 571/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:19 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:20.655810 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:20.656871 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:20.663468 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.664253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.664804 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.665543 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.670097 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.670097 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.814034 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-d7255553-30ed-465b-8d92-3bee7146cf44 req-198a4cbd-2261-431d-8acc-c20cdbbe2dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23bf5d5-4f4e-4d26-8cce-c879c3204f1b", "tag": "97b27e98-0ada-4f95-b23e-4230a98c83c7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:20.834717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d7255553-30ed-465b-8d92-3bee7146cf44 req-198a4cbd-2261-431d-8acc-c20cdbbe2dc7 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:20.836000 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d7255553-30ed-465b-8d92-3bee7146cf44 req-198a4cbd-2261-431d-8acc-c20cdbbe2dc7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:20.837010 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-d7255553-30ed-465b-8d92-3bee7146cf44 req-198a4cbd-2261-431d-8acc-c20cdbbe2dc7 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:20.848463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:20.858157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff5186fc-63cf-4f09-9c3e-f575f76bff21 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.207460 Aug 24 11:35:20.866126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-d7255553-30ed-465b-8d92-3bee7146cf44 req-198a4cbd-2261-431d-8acc-c20cdbbe2dc7 service nova] Creating event network-changed:97b27e98-0ada-4f95-b23e-4230a98c83c7 for instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b on hv-cinder-85427 Aug 24 11:35:20.867968 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 596/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:20 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:20.868891 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-d7255553-30ed-465b-8d92-3bee7146cf44 req-198a4cbd-2261-431d-8acc-c20cdbbe2dc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061194 Aug 24 11:35:20.870786 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 572/1168] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:21.881687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:21.883059 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:21.886669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:21.886669 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:21.895485 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:21.896262 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:21.897288 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:21.897565 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:21.898248 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:21.898956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:22.064386 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:22.072959 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02e386cf-2777-4264-8a19-43f1d4d05d3d tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.194830 Aug 24 11:35:22.073638 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 597/1169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:21 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:23.091298 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell0:SELECT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:23.096978 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:23.097463 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:23.099479 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:23.109184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.109184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.109184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.109184 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.109684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.109684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.114137 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=89 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:23.651861 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:23.668693 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-86fac836-2790-46e9-aa36-e89bd4127808 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.578764 Aug 24 11:35:23.682269 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 573/1170] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:23 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:24.690077 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:24.690687 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:24.693322 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:24.700028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:24.700456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:24.700892 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:24.701619 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:24.702069 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:24.702493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:24.705799 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=81 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:24.843802 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:24.851729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e1e6b18-feef-44e0-be1b-c22572cd53e1 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.165570 Aug 24 11:35:24.852486 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 598/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:24 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:25.876373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:25.876956 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:25.883504 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:25.883995 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:25.884429 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:25.885991 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:25.886536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:25.886957 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:26.024054 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:26.031855 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b7b3812c-ada5-4f70-9e17-b73d4666f7c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.159716 Aug 24 11:35:26.032428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 574/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:25 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:27.062864 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:27.063627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:27.070197 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:27.070678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:27.071108 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:27.071803 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:27.072280 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:27.072703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:27.225713 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:27.234506 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a317477d-be2d-4c4e-a03e-386529a38201 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.175678 Aug 24 11:35:27.237422 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 599/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:27 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:28.266457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:28.267067 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:28.273642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:28.274127 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:28.274565 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:28.275915 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:28.276385 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:28.276799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:28.438484 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:28.446531 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-7ed58cbe-b959-4e17-ac6c-5b7b40148b0e tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.183774 Aug 24 11:35:28.447590 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 575/1174] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:28 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:29.469259 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:29.470762 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:29.480051 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:29.480550 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:29.480987 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.481747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:29.482196 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:29.482621 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.637797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:29.646677 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a2619c57-bf83-4556-852c-2c21838917c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.182102 Aug 24 11:35:29.647260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 600/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:29 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:30.505392 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-14e73fac-431f-433f-b865-0affee00ea43 req-adb5db0c-0f6b-457b-8185-c8bedbfe134f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23bf5d5-4f4e-4d26-8cce-c879c3204f1b", "name": "network-vif-plugged", "status": "completed", "tag": "97b27e98-0ada-4f95-b23e-4230a98c83c7"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:30.517773 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-14e73fac-431f-433f-b865-0affee00ea43 req-adb5db0c-0f6b-457b-8185-c8bedbfe134f service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.518026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-14e73fac-431f-433f-b865-0affee00ea43 req-adb5db0c-0f6b-457b-8185-c8bedbfe134f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.518431 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-14e73fac-431f-433f-b865-0affee00ea43 req-adb5db0c-0f6b-457b-8185-c8bedbfe134f service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.533428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-14e73fac-431f-433f-b865-0affee00ea43 req-adb5db0c-0f6b-457b-8185-c8bedbfe134f service nova] Creating event network-vif-plugged:97b27e98-0ada-4f95-b23e-4230a98c83c7 for instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b on hv-cinder-85427 Aug 24 11:35:30.540005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-14e73fac-431f-433f-b865-0affee00ea43 req-adb5db0c-0f6b-457b-8185-c8bedbfe134f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039276 Aug 24 11:35:30.540620 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 576/1176] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:30.672391 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:30.673105 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:30.679647 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.680223 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.680729 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.681697 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.682144 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.682638 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.862537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:30.873155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb562116-e97c-499c-a8a1-4c50aa9173d7 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.207734 Aug 24 11:35:30.873797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 601/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:30 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:31.897876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:31.898581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:31.907816 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:31.908360 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:31.908740 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:31.909490 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:31.909953 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:31.910376 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:32.084568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:32.092616 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cee2666f-5697-4d99-88da-ba73371353c5 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1265 microversion: 2.1 time: 0.199473 Aug 24 11:35:32.093225 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 577/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:31 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:33.117422 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:33.119254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:33.128757 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:33.129450 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:33.129902 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:33.131126 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:33.132028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:33.132549 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:33.306812 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:33.320062 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ef9deb7-f8d1-48ad-8da2-b35676243546 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1452 microversion: 2.1 time: 0.207293 Aug 24 11:35:33.320925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 602/1179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:33 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:35:33.406119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:33.406682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:33.413373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:33.413871 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:33.414305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:33.415012 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:33.415466 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:33.416450 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:33.570804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:33.579214 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-9b9ef6cd-ed1a-40c6-8fef-ed9d1e353c29 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1452 microversion: 2.1 time: 0.177314 Aug 24 11:35:33.579785 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 578/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:33 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:35.740584 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bf2a6887-96dd-453f-8847-ee1e361ed2dd req-827b237d-4dff-4339-9a58-f374fd8713fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23bf5d5-4f4e-4d26-8cce-c879c3204f1b", "tag": "97b27e98-0ada-4f95-b23e-4230a98c83c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:35.751531 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bf2a6887-96dd-453f-8847-ee1e361ed2dd req-827b237d-4dff-4339-9a58-f374fd8713fe service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:35.752007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bf2a6887-96dd-453f-8847-ee1e361ed2dd req-827b237d-4dff-4339-9a58-f374fd8713fe service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:35.752551 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bf2a6887-96dd-453f-8847-ee1e361ed2dd req-827b237d-4dff-4339-9a58-f374fd8713fe service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:35.767493 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bf2a6887-96dd-453f-8847-ee1e361ed2dd req-827b237d-4dff-4339-9a58-f374fd8713fe service nova] Creating event network-changed:97b27e98-0ada-4f95-b23e-4230a98c83c7 for instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b on hv-cinder-85427 Aug 24 11:35:35.776563 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bf2a6887-96dd-453f-8847-ee1e361ed2dd req-827b237d-4dff-4339-9a58-f374fd8713fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038854 Aug 24 11:35:35.777768 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 603/1181] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:27.454917 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:36:27.455627 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:37:15.448729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14b0a7f5-6a5e-48b8-ad83-1fd7c9fdec5f] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:37:15.449707 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=11 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:15.450536 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=31 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:15.451202 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e3a5a2bc-d051-488a-b3d1-616689c49930] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:37:15.452286 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=11 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:15.453014 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=31 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:15.456165 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:15.456552 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:15.465862 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.466353 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.466795 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:15.467998 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.468461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.469036 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:15.498201 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:37:15.584393 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-161fa312-e33b-4704-8722-0c200556a8ca tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 204 len: 0 microversion: 2.1 time: 0.136878 Aug 24 11:37:15.585612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 579/1182] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:37:15 2022] DELETE /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:37:15.596172 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:15.596898 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:15.603196 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.603606 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.604052 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:15.604914 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.605592 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.605887 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:15.674188 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-2dacbd5e-2b01-4d7d-a5a7-262145bcbed7 req-5063bf47-8ddc-4e7d-9e6d-5af709814af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23bf5d5-4f4e-4d26-8cce-c879c3204f1b", "tag": "97b27e98-0ada-4f95-b23e-4230a98c83c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:15.690433 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2dacbd5e-2b01-4d7d-a5a7-262145bcbed7 req-5063bf47-8ddc-4e7d-9e6d-5af709814af1 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:15.691324 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2dacbd5e-2b01-4d7d-a5a7-262145bcbed7 req-5063bf47-8ddc-4e7d-9e6d-5af709814af1 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:15.692747 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-2dacbd5e-2b01-4d7d-a5a7-262145bcbed7 req-5063bf47-8ddc-4e7d-9e6d-5af709814af1 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:15.705866 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-2dacbd5e-2b01-4d7d-a5a7-262145bcbed7 req-5063bf47-8ddc-4e7d-9e6d-5af709814af1 service nova] Creating event network-changed:97b27e98-0ada-4f95-b23e-4230a98c83c7 for instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b on hv-cinder-85427 Aug 24 11:37:15.711254 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-2dacbd5e-2b01-4d7d-a5a7-262145bcbed7 req-5063bf47-8ddc-4e7d-9e6d-5af709814af1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262117 Aug 24 11:37:15.712408 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 604/1183] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:15.867026 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:15.875896 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c4ceff1-a96d-4337-9245-c12eb0feefbc tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1576 microversion: 2.1 time: 0.285365 Aug 24 11:37:15.876475 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 580/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:15 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:16.900019 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:16.900911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:16.908463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:16.908952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:16.909429 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.910178 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:16.910637 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:16.911064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.916851 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [e3a5a2bc-d051-488a-b3d1-616689c49930] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60032. Aug 24 11:37:17.110226 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:17.118379 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0dc50a9a-2c4f-46fb-9cd6-c44a29ecdd1f tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1576 microversion: 2.1 time: 0.225015 Aug 24 11:37:17.118965 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 605/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:16 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:18.143810 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:18.144424 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:18.150471 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8c465420-5767-47f4-b4c2-cfb8f8c99382 req-3f6a2606-f6da-4085-807e-10e05678a934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23bf5d5-4f4e-4d26-8cce-c879c3204f1b", "name": "network-vif-deleted", "tag": "97b27e98-0ada-4f95-b23e-4230a98c83c7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:18.153093 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.153713 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.154154 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.154866 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.155390 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.155830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.166843 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8c465420-5767-47f4-b4c2-cfb8f8c99382 req-3f6a2606-f6da-4085-807e-10e05678a934 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.167318 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8c465420-5767-47f4-b4c2-cfb8f8c99382 req-3f6a2606-f6da-4085-807e-10e05678a934 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.167763 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8c465420-5767-47f4-b4c2-cfb8f8c99382 req-3f6a2606-f6da-4085-807e-10e05678a934 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.180877 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] [14b0a7f5-6a5e-48b8-ad83-1fd7c9fdec5f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60044. Aug 24 11:37:18.183339 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8c465420-5767-47f4-b4c2-cfb8f8c99382 req-3f6a2606-f6da-4085-807e-10e05678a934 service nova] Creating event network-vif-deleted:97b27e98-0ada-4f95-b23e-4230a98c83c7 for instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b on hv-cinder-85427 Aug 24 11:37:18.189657 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8c465420-5767-47f4-b4c2-cfb8f8c99382 req-3f6a2606-f6da-4085-807e-10e05678a934 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045877 Aug 24 11:37:18.190267 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 606/1186] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:18.227610 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:18.236438 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-c35e1c67-0541-49e1-93b0-2980e000b776 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 200 len: 1391 microversion: 2.1 time: 0.099822 Aug 24 11:37:18.237160 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 581/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:18 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:19.259341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:19.260034 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: e23bf5d5-4f4e-4d26-8cce-c879c3204f1b] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:19.268235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.268719 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.269155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.269880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.270327 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.270745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.285106 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] HTTP exception thrown: Instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b could not be found. Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Request method failure captured: Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b HTTP/1.1 Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBguipREvgerYP2Ri8eioU33XRfCHSLu-FRVbFfoMijbiRqcyYhOWoKu6tYubooNM3ZeA2512nkL6Wt0MHO3oT98zhddjlDSKkv49XPHpbho8HycHZLtdncc9PZmA2HwZZCxMNmJdfwy7mhxHc9iuhBp_imcff1SlyVrJ8FWQDC9QSXs Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: e54623c55367410db8070615915e573e Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:37:19.286829 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e54623c55367410db8070615915e573e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e54623c55367410db8070615915e573e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: e54623c55367410db8070615915e573e Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: cbeabb83431b4536b4c5fdf71e8a5a80 Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b could not be found. Aug 24 11:37:19.289335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e23bf5d5-4f4e-4d26-8cce-c879c3204f1b'} Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b could not be found. Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:19.290722 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b could not be found. Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b could not be found. Aug 24 11:37:19.292956 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:19.294673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Returning 404 to user: Instance e23bf5d5-4f4e-4d26-8cce-c879c3204f1b could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:19.294673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-86ddcadb-ef31-4fa7-aedb-9339a5815f07 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b" status: 404 len: 111 microversion: 2.1 time: 0.033144 Aug 24 11:37:19.294673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 607/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:19 2022] GET /compute/v2.1/servers/e23bf5d5-4f4e-4d26-8cce-c879c3204f1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:22.671097 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:22.671855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f17b5d68-cec8-4796-9213-b5cad5309005 req-ace1bb86-cbcb-462b-84ad-72acf480a9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9a21fe-45de-4237-a6e4-2f089bf93fcb", "tag": "31271296-5c4a-403b-a533-e376d7b48425"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:22.672242 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:22.681057 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f17b5d68-cec8-4796-9213-b5cad5309005 req-ace1bb86-cbcb-462b-84ad-72acf480a9ee service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.681724 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f17b5d68-cec8-4796-9213-b5cad5309005 req-ace1bb86-cbcb-462b-84ad-72acf480a9ee service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.682161 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f17b5d68-cec8-4796-9213-b5cad5309005 req-ace1bb86-cbcb-462b-84ad-72acf480a9ee service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.687729 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.688337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.688827 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.691317 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.691864 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.692796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.694850 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f17b5d68-cec8-4796-9213-b5cad5309005 req-ace1bb86-cbcb-462b-84ad-72acf480a9ee service nova] Creating event network-changed:31271296-5c4a-403b-a533-e376d7b48425 for instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb on hv-cinder-85427 Aug 24 11:37:22.700230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f17b5d68-cec8-4796-9213-b5cad5309005 req-ace1bb86-cbcb-462b-84ad-72acf480a9ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Aug 24 11:37:22.700833 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 608/1189] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:22.731417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Going to try to terminate instance {{(pid=120722) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:37:22.837168 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-de314ef3-d6b2-4cab-90bf-310e7130f6ae tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 204 len: 0 microversion: 2.1 time: 0.171137 Aug 24 11:37:22.838623 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 582/1190] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:37:22 2022] DELETE /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:37:22.848314 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:22.849372 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:22.856025 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.856958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.857443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.859011 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.859728 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.860163 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.006949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:23.015443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-edd26688-c58c-4474-94a8-466d2b72ae1a tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1576 microversion: 2.1 time: 0.171832 Aug 24 11:37:23.016028 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 609/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:22 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:24.036600 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:24.037335 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:24.043796 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.044289 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.044730 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.045959 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.046414 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.046838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.214405 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:24.223511 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-a61a4d16-7e8b-404f-89c6-4315cfe4be62 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1576 microversion: 2.1 time: 0.191071 Aug 24 11:37:24.224015 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 583/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:24 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:25.072933 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d6d7c058-7af9-43d8-9da8-fe051dc4179d req-307a2760-a848-4713-ab48-3005b0ce88de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9a21fe-45de-4237-a6e4-2f089bf93fcb", "name": "network-vif-deleted", "tag": "31271296-5c4a-403b-a533-e376d7b48425"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:25.083751 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6d7c058-7af9-43d8-9da8-fe051dc4179d req-307a2760-a848-4713-ab48-3005b0ce88de service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.084294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6d7c058-7af9-43d8-9da8-fe051dc4179d req-307a2760-a848-4713-ab48-3005b0ce88de service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.084718 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d6d7c058-7af9-43d8-9da8-fe051dc4179d req-307a2760-a848-4713-ab48-3005b0ce88de service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.097696 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d6d7c058-7af9-43d8-9da8-fe051dc4179d req-307a2760-a848-4713-ab48-3005b0ce88de service nova] Creating event network-vif-deleted:31271296-5c4a-403b-a533-e376d7b48425 for instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb on hv-cinder-85427 Aug 24 11:37:25.103465 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d6d7c058-7af9-43d8-9da8-fe051dc4179d req-307a2760-a848-4713-ab48-3005b0ce88de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 Aug 24 11:37:25.104335 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 610/1193] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:25.245379 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:25.246030 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:25.253777 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.254261 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.254691 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.255384 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.255830 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.256246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.322480 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbeabb83431b4536b4c5fdf71e8a5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54623c55367410db8070615915e573e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:25.331804 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3e43ae26-06f9-48fe-9740-a5a43e695dcb tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 200 len: 1225 microversion: 2.1 time: 0.090295 Aug 24 11:37:25.332320 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 584/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:25 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:26.355706 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:26.356425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: ba9a21fe-45de-4237-a6e4-2f089bf93fcb] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:26.362947 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.363407 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.363840 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.364530 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.364977 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.365425 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.379099 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] HTTP exception thrown: Instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb could not be found. Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Request method failure captured: Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb HTTP/1.1 Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBguipREvgerYP2Ri8eioU33XRfCHSLu-FRVbFfoMijbiRqcyYhOWoKu6tYubooNM3ZeA2512nkL6Wt0MHO3oT98zhddjlDSKkv49XPHpbho8HycHZLtdncc9PZmA2HwZZCxMNmJdfwy7mhxHc9iuhBp_imcff1SlyVrJ8FWQDC9QSXs Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: e54623c55367410db8070615915e573e Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:37:26.381016 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e54623c55367410db8070615915e573e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e54623c55367410db8070615915e573e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: e54623c55367410db8070615915e573e Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: cbeabb83431b4536b4c5fdf71e8a5a80 Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb could not be found. Aug 24 11:37:26.382960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': 'ba9a21fe-45de-4237-a6e4-2f089bf93fcb'} Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb could not be found. Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:26.383868 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb could not be found. Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb could not be found. Aug 24 11:37:26.385368 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.386633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Returning 404 to user: Instance ba9a21fe-45de-4237-a6e4-2f089bf93fcb could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:26.386633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-65e706d4-06cb-47d8-83cd-041ad90e3480 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb" status: 404 len: 111 microversion: 2.1 time: 0.031507 Aug 24 11:37:26.386633 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 611/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:26 2022] GET /compute/v2.1/servers/ba9a21fe-45de-4237-a6e4-2f089bf93fcb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:26.835890 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:26.836451 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:26.843708 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.844579 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.845022 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.845768 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.846229 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.846658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.860756 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] HTTP exception thrown: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Request method failure captured: Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: DELETE /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 HTTP/1.1 Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBguipREvgerYP2Ri8eioU33XRfCHSLu-FRVbFfoMijbiRqcyYhOWoKu6tYubooNM3ZeA2512nkL6Wt0MHO3oT98zhddjlDSKkv49XPHpbho8HycHZLtdncc9PZmA2HwZZCxMNmJdfwy7mhxHc9iuhBp_imcff1SlyVrJ8FWQDC9QSXs Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: e54623c55367410db8070615915e573e Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:37:26.862464 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e54623c55367410db8070615915e573e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e54623c55367410db8070615915e573e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: e54623c55367410db8070615915e573e Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: cbeabb83431b4536b4c5fdf71e8a5a80 Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.864219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '75ca60a3-533e-48ea-a0f9-5fd4270c8164'} Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:26.865223 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.866811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.868406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Returning 404 to user: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:26.868406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3a5531e1-4b4e-4072-a64c-df6a0da55ac4 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 404 len: 111 microversion: 2.1 time: 0.031951 Aug 24 11:37:26.868406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 585/1196] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:37:26 2022] DELETE /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:26.872848 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:26.873487 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] [instance: 75ca60a3-533e-48ea-a0f9-5fd4270c8164] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:26.879965 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.880452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.880886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.881620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.882070 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.882495 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.897761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] HTTP exception thrown: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Request method failure captured: Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 HTTP/1.1 Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept: application/json Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Connection: close Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Length: 0 Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Content-Type: application/json Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Host: 10.222.0.17 Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjBguipREvgerYP2Ri8eioU33XRfCHSLu-FRVbFfoMijbiRqcyYhOWoKu6tYubooNM3ZeA2512nkL6Wt0MHO3oT98zhddjlDSKkv49XPHpbho8HycHZLtdncc9PZmA2HwZZCxMNmJdfwy7mhxHc9iuhBp_imcff1SlyVrJ8FWQDC9QSXs Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Id: e54623c55367410db8070615915e573e Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Role: reader,member Aug 24 11:37:26.899277 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Roles: reader,member Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e54623c55367410db8070615915e573e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e54623c55367410db8070615915e573e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e54623c55367410db8070615915e573e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Id: e54623c55367410db8070615915e573e Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1552883070 Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Id: cbeabb83431b4536b4c5fdf71e8a5a80 Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-1552883070-project Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: method: > Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: exception: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.900950 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: action_args: {'id': '75ca60a3-533e-48ea-a0f9-5fd4270c8164'} Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:26.901949 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. Aug 24 11:37:26.903505 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.905136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Returning 404 to user: Instance 75ca60a3-533e-48ea-a0f9-5fd4270c8164 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:26.905136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-684dd3b5-415c-4c21-a70e-ae3c62be5d42 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164" status: 404 len: 111 microversion: 2.1 time: 0.031860 Aug 24 11:37:26.905136 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 612/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:26 2022] GET /compute/v2.1/servers/75ca60a3-533e-48ea-a0f9-5fd4270c8164 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:37:28.229461 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-d26fe069-2fcd-4032-8991-deef6efb53b3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] Calling method '.version_select at 0x7f5ba482ee50>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:28.258050 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-d26fe069-2fcd-4032-8991-deef6efb53b3 tempest-TestVolumeBootPattern-1552883070 tempest-TestVolumeBootPattern-1552883070-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-564613301" status: 202 len: 0 microversion: 2.1 time: 0.032698 Aug 24 11:37:28.259120 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 586/1198] 10.222.0.17 () {58 vars in 1260 bytes} [Wed Aug 24 11:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-564613301 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:37:31.126632 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:31.128246 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:31.136576 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:31.137960 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:31.138620 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:31.140272 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:31.140924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:31.141569 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:31.174533 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lazy-loading 'flavor' on Instance uuid 0bbb0462-1cae-4bef-ac83-80e494c84d08 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:37:31.285978 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc38a315-c92d-4a84-bef6-d30a7985bedb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "POST /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08/action" status: 202 len: 0 microversion: 2.1 time: 0.164773 Aug 24 11:37:31.287294 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 613/1199] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:37:31 2022] POST /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:37:31.296222 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:31.298706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:31.307091 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:31.308373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:31.309152 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:31.310684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:31.311588 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:31.312334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:31.535457 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:31.549267 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-779e6c5a-93ad-4179-9546-40dbed600b31 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.257292 Aug 24 11:37:31.549949 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 587/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:31 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:32.572003 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:32.572887 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:32.579920 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:32.580406 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:32.580842 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:32.581583 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:32.582037 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:32.582463 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:32.813094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:32.821099 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d8c5d51-4346-4ace-8a71-bdb6d810f216 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.253486 Aug 24 11:37:32.834552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 614/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:32 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:33.846642 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:33.847572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:33.857857 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:33.858383 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:33.859367 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:33.860356 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:33.860821 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:33.861426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:34.010470 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:34.023657 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b36bf37c-77aa-4e23-9cdd-aa8da6b177aa tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.183895 Aug 24 11:37:34.024555 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 588/1202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:33 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:35.046255 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:35.047345 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:35.055168 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:35.056132 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:35.056792 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:35.059235 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:35.059824 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:35.060441 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:35.303157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:35.312456 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5cfdd81-430c-4e2d-a443-f22799764aa6 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.269582 Aug 24 11:37:35.313084 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 615/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:35 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:36.334428 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:36.335057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:36.342166 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.342720 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.343799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.344568 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:36.345092 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:36.345551 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:36.500402 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:36.508282 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-22ea0dc1-74fa-4e26-af0c-3d34feb1e71f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.177859 Aug 24 11:37:36.508852 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 589/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:36 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:37.530279 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:37.531107 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:37.538017 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.538496 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.538925 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.539703 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:37.540155 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:37.540568 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:37.679869 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:37.688351 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7edab68b-e5ea-4991-b664-2c2413fdb4a8 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.161951 Aug 24 11:37:37.689116 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 616/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:37 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:38.709421 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:38.710041 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:38.716572 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:38.717057 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:38.717546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:38.719434 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:38.719889 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:38.720309 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:38.858564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:38.866564 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5d4897c9-3ff2-433c-afe3-90c3f4fe662b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.161058 Aug 24 11:37:38.867133 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 590/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:38 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:39.888951 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:39.889667 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:39.896592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.897071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.897537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.898253 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.898707 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.899130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:40.037891 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.046172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fc7feed-5962-4c37-bf66-2111c15f8e5f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.160451 Aug 24 11:37:40.046742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 617/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:39 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:41.067622 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:41.068232 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:41.074548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:41.075024 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:41.075455 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:41.076138 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:41.076583 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:41.077682 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:41.212094 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:41.220366 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-bd2be72e-60de-4625-b230-dbce5d09dcbb tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.156542 Aug 24 11:37:41.220985 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 591/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:41 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:42.240256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:42.240867 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:42.247501 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.247982 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.248761 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.249726 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.250204 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.250618 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.384580 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.392403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18f8946e-855d-488e-8c99-2f2fd3383260 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.155989 Aug 24 11:37:42.392958 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 618/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:42 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:43.413945 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:43.414560 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:43.420965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.421500 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.421922 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.422617 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.423072 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.423497 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.555441 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:43.564042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-cdf5c40a-8bba-4146-9245-3d5a388b225f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.153927 Aug 24 11:37:43.564604 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 592/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:43 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:44.586193 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.586835 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.594435 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.594936 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.595403 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.596092 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.596537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.596953 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.732180 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:44.740172 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08d9764c-203d-4ed6-934a-2f52a121ba20 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1511 microversion: 2.1 time: 0.158297 Aug 24 11:37:44.740739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 619/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:44 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:44.760677 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:44.761334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.768561 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.769042 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.769507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.770237 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.770684 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.771108 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.799829 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120722) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:37:44.820811 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:44.862668 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [91f95878-cd93-40fe-8540-1e9f4db6bf67] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:37:45.870101 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [91f95878-cd93-40fe-8540-1e9f4db6bf67] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 60170. Aug 24 11:37:45.874882 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-43345c7f-3699-400d-8159-916e10938b16 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "POST /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08/action" status: 202 len: 0 microversion: 2.1 time: 1.117980 Aug 24 11:37:45.875507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 593/1212] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 24 11:37:44 2022] POST /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08/action => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:37:45.884093 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:45.884838 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:45.887230 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=33 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:45.893983 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.894673 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.895303 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.896068 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.897127 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.897880 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.902886 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:46.038256 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.047135 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-46966b4a-8655-4374-ba74-9f3f2d1dcf9f tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1519 microversion: 2.1 time: 0.166735 Aug 24 11:37:46.047924 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 620/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:45 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:47.069287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.069911 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.073809 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:47.078219 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.078722 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.079192 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.079973 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.080424 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.080954 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.241592 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-901953a1-a950-47f9-a29c-d36e07a07aef req-69a34201-7e74-4ec3-bd32-90200fa42798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "name": "network-vif-unplugged", "status": "completed", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:47.252552 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-901953a1-a950-47f9-a29c-d36e07a07aef req-69a34201-7e74-4ec3-bd32-90200fa42798 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.253064 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-901953a1-a950-47f9-a29c-d36e07a07aef req-69a34201-7e74-4ec3-bd32-90200fa42798 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.253537 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-901953a1-a950-47f9-a29c-d36e07a07aef req-69a34201-7e74-4ec3-bd32-90200fa42798 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.267416 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-901953a1-a950-47f9-a29c-d36e07a07aef req-69a34201-7e74-4ec3-bd32-90200fa42798 service nova] Unable to find a host for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 11:37:47.269241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-901953a1-a950-47f9-a29c-d36e07a07aef req-69a34201-7e74-4ec3-bd32-90200fa42798 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.201621 Aug 24 11:37:47.269241 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 621/1214] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 203 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 11:37:47.281395 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.289546 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4d8fabea-cce3-4c88-897c-f12dc5f0d92b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1519 microversion: 2.1 time: 0.224082 Aug 24 11:37:47.290227 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 594/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:48.310166 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:48.310809 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:48.317870 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.318362 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.318957 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.319701 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.320160 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.320590 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.459143 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.466911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d581f49-6b91-47c8-8333-e4de0a82dad7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1519 microversion: 2.1 time: 0.160699 Aug 24 11:37:48.467523 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 622/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:48 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:49.489063 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:49.489717 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:49.496176 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.496663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.497378 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.498084 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.498595 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.499520 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.637658 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.648547 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-4c4751cb-9d1b-4ef2-9d4e-6597bfc7fa8b tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1519 microversion: 2.1 time: 0.163413 Aug 24 11:37:49.649132 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 595/1217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:49 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:50.670224 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.671447 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.678742 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.679227 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.679663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.680419 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.681159 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.681296 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.821054 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.831066 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac42bfe6-15a1-4f68-b0d4-6ee2d6fad1f2 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1519 microversion: 2.1 time: 0.164573 Aug 24 11:37:50.833181 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 623/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:51.855170 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:51.855799 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:51.862346 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.862817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.863252 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.863947 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.864397 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.864817 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.051825 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.059685 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3b2bf031-c96b-4eb6-84b6-736ab503abc7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.208409 Aug 24 11:37:52.060256 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 596/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:51 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:53.082038 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.082686 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:53.089298 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.089777 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.090205 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.090895 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.091341 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.091796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.228952 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.241130 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d58f2d6e-441e-446a-bf0e-9ba8c83affd9 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.162829 Aug 24 11:37:53.241883 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 624/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:53 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:54.262675 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:54.263286 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:54.270639 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.271177 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.272040 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.272744 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.273194 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.273637 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.405381 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:54.413182 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e57e9894-071a-4b2b-8e64-13e152508871 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.154323 Aug 24 11:37:54.413770 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 597/1221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:54 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:55.433640 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:55.434244 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:55.441301 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.441780 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.442207 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.442885 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.443329 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.443745 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.575513 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.583801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ced160a8-ed53-4ef8-a8d4-e80cb609a3db tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.153976 Aug 24 11:37:55.584352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 625/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:55 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:56.606699 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:56.607334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:56.613847 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:56.614323 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:56.614750 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.615431 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:56.615876 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:56.616292 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:56.743888 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:56.752373 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-3d255bb4-fe9a-4909-a629-da5bb97b2a38 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.149493 Aug 24 11:37:56.752929 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 598/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:56 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:57.773490 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:57.774123 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:57.780961 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.781646 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.782056 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.782738 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:57.783183 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:57.783597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:57.915374 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:57.923778 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-376db93b-d99f-487d-9ac7-e7fcbe9c6078 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.154073 Aug 24 11:37:57.924349 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 626/1224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:57 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:58.944692 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:58.945337 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:58.951793 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.952277 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.953712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.953712 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.953940 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.954425 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.087126 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.095630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-5c2165ed-7775-4591-b9b9-bfd9641bbe93 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.154730 Aug 24 11:37:59.096197 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 599/1225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:58 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:00.116342 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:00.116988 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:00.124191 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.124396 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.125410 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.126205 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.126680 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.127103 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.261801 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.269658 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8e3a87b-f138-46e1-ab29-0565cb0e52a0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.157077 Aug 24 11:38:00.270231 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 627/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:00 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:01.291066 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:01.291776 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:01.298835 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.299404 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.299897 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.300656 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.301169 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.301706 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.438612 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.446201 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-53052acb-0d90-43f6-a21d-031186abbe99 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.158982 Aug 24 11:38:01.446763 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 600/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:01 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:02.468060 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:02.468797 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:02.475005 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.475481 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.475912 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.476597 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.477047 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.477503 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.614821 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:02.622720 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69d9a5d4-6bcb-4296-b465-4bc083b4f168 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.158512 Aug 24 11:38:02.623293 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 628/1228] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:02 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:03.210838 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-9bc5731d-2589-4131-aa71-abb9edeb3741 req-8876698b-5da9-4f2a-9435-28d7f12a960d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "name": "network-vif-plugged", "status": "completed", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:03.223246 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9bc5731d-2589-4131-aa71-abb9edeb3741 req-8876698b-5da9-4f2a-9435-28d7f12a960d service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:03.223858 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9bc5731d-2589-4131-aa71-abb9edeb3741 req-8876698b-5da9-4f2a-9435-28d7f12a960d service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:03.224305 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-9bc5731d-2589-4131-aa71-abb9edeb3741 req-8876698b-5da9-4f2a-9435-28d7f12a960d service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.236002 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-9bc5731d-2589-4131-aa71-abb9edeb3741 req-8876698b-5da9-4f2a-9435-28d7f12a960d service nova] Creating event network-vif-plugged:a1b7855f-6056-41a0-8e11-2db822f8d6be for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 on hv-cinder-85427 Aug 24 11:38:03.242157 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-9bc5731d-2589-4131-aa71-abb9edeb3741 req-8876698b-5da9-4f2a-9435-28d7f12a960d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034561 Aug 24 11:38:03.243143 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 601/1229] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:03.644167 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:03.644771 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:03.651223 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:03.651693 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:03.652120 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.652796 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:03.653260 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:03.653678 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.784295 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.791885 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-361bd8c9-d16c-4c0c-b8bd-9bf3f40ef64a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1577 microversion: 2.1 time: 0.151952 Aug 24 11:38:03.792441 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 629/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:03 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:04.720889 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:38:04.721443 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:38:04.814287 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:04.814989 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:04.821630 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.822112 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.822548 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.823241 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.823693 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.824119 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.959417 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.967243 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-48d46302-5ce4-4a5d-a733-a4665c89ab8e tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1564 microversion: 2.1 time: 0.157860 Aug 24 11:38:04.967813 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 602/1231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:04 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:19.159611 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=19 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:19.161007 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=55 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:19.162375 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_api:SELECT=17 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:19.163037 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG dbcounter [-] [120722] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:19.165285 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:19.165793 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:19.167253 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-8718f62c-639a-42ac-88e6-a573dd1bab6f req-a10408f1-607a-4727-8cf4-d585b5f30152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:19.179175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8718f62c-639a-42ac-88e6-a573dd1bab6f req-a10408f1-607a-4727-8cf4-d585b5f30152 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.179175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8718f62c-639a-42ac-88e6-a573dd1bab6f req-a10408f1-607a-4727-8cf4-d585b5f30152 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.179175 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-8718f62c-639a-42ac-88e6-a573dd1bab6f req-a10408f1-607a-4727-8cf4-d585b5f30152 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.183587 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.184075 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.184538 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.185222 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.185670 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.186195 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.192618 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-8718f62c-639a-42ac-88e6-a573dd1bab6f req-a10408f1-607a-4727-8cf4-d585b5f30152 service nova] Creating event network-changed:a1b7855f-6056-41a0-8e11-2db822f8d6be for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 on hv-cinder-85427 Aug 24 11:39:19.197965 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-8718f62c-639a-42ac-88e6-a573dd1bab6f req-a10408f1-607a-4727-8cf4-d585b5f30152 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037674 Aug 24 11:39:19.198571 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 603/1232] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:39:19.214516 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:39:19.315772 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7928cf4c-3e64-45f7-87a2-dfdeb6cea683 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 204 len: 0 microversion: 2.1 time: 0.157017 Aug 24 11:39:19.315772 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 630/1233] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 24 11:39:19 2022] DELETE /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:39:19.325686 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:19.326581 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:19.335521 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.336362 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.336999 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.338018 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.338663 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.339240 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.813948 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.policy [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120722) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:19.821751 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-b2a78ac1-141a-4092-8fe2-1dc9aed9b2f7 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.501259 Aug 24 11:39:19.822325 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 604/1234] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:19 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:20.845896 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:20.846911 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:20.853595 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.854071 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.854496 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.855186 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:20.855626 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:20.856039 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.002702 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:21.010452 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d62adf7-bdb4-4d9b-bac0-8d78c309b559 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1570 microversion: 2.1 time: 0.169025 Aug 24 11:39:21.011008 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 631/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:20 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:21.626064 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [req-82a9322d-411e-4fd9-822d-6c746f156172 req-319058e5-cf8c-4eb5-bf75-a6f292911701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb0462-1cae-4bef-ac83-80e494c84d08", "name": "network-vif-deleted", "tag": "a1b7855f-6056-41a0-8e11-2db822f8d6be"}]} {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:21.636392 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-82a9322d-411e-4fd9-822d-6c746f156172 req-319058e5-cf8c-4eb5-bf75-a6f292911701 service nova] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.636863 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-82a9322d-411e-4fd9-822d-6c746f156172 req-319058e5-cf8c-4eb5-bf75-a6f292911701 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.637313 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [req-82a9322d-411e-4fd9-822d-6c746f156172 req-319058e5-cf8c-4eb5-bf75-a6f292911701 service nova] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.648538 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.compute.server_external_events [req-82a9322d-411e-4fd9-822d-6c746f156172 req-319058e5-cf8c-4eb5-bf75-a6f292911701 service nova] Creating event network-vif-deleted:a1b7855f-6056-41a0-8e11-2db822f8d6be for instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 on hv-cinder-85427 Aug 24 11:39:21.654059 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [req-82a9322d-411e-4fd9-822d-6c746f156172 req-319058e5-cf8c-4eb5-bf75-a6f292911701 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Aug 24 11:39:21.654695 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 605/1236] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:22.032855 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:22.033520 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:22.039884 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.040366 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.040879 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.041691 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.042141 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.042559 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.107352 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd2ffa2af3401f84c07b5b6015e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8715407500f24272b8f4a16d3e2598c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:22.115733 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f76d6d6-344c-4859-b30c-3e2eedc2c767 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 200 len: 1220 microversion: 2.1 time: 0.088131 Aug 24 11:39:22.116547 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 632/1237] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:22 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:23.137103 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '>' {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:23.137842 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.compute.api [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] [instance: 0bbb0462-1cae-4bef-ac83-80e494c84d08] Fetching instance by UUID {{(pid=120722) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:23.144213 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.144694 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.145128 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.145846 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Acquiring lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.146297 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.146720 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG oslo_concurrency.lockutils [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Lock "e6eb4bc1-ba3f-44a1-ac45-6d12b1f3a42c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.161005 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.wsgi [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] HTTP exception thrown: Instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 could not be found. Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Request method failure captured: Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: request: GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 HTTP/1.1 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept: application/json Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Accept-Encoding: identity Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Connection: close Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Length: 0 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Content-Type: application/json Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Host: 10.222.0.17 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Openstack-System-Scope: None Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: User-Agent: python-urllib3/1.26.11 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Auth-Token: gAAAAABjBgy0oJbrVFTuxHnkngCh4OEUSoyBlyhEvIg38hWS2mpiBsbSRsRPwIhnfuNhMz91WMj5VZREK1UDzE45C2pU5LOQgw3ZlnuXcEnRjupO908Zm5GhN3EDUcvQaEZCMUCTJxv8WXJuk8iX6NGluzTHSnygWYYHC_Xujss3nmDG6EcsWp0 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Id: None Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Domain-Name: None Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Identity-Status: Confirmed Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Is-Admin-Project: True Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Id: default Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Domain-Name: Default Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Id: 8715407500f24272b8f4a16d3e2598c4 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Project-Name: tempest-TestShelveInstance-1507112614 Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Role: reader,member Aug 24 11:39:23.162704 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Roles: reader,member Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8715407500f24272b8f4a16d3e2598c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8715407500f24272b8f4a16d3e2598c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8715407500f24272b8f4a16d3e2598c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8715407500f24272b8f4a16d3e2598c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant: tempest-TestShelveInstance-1507112614 Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Id: 8715407500f24272b8f4a16d3e2598c4 Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-Tenant-Name: tempest-TestShelveInstance-1507112614 Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User: tempest-TestShelveInstance-1507112614-project Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Id: default Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Domain-Name: Default Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Id: a7fd2ffa2af3401f84c07b5b6015e75a Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: X-User-Name: tempest-TestShelveInstance-1507112614-project Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: method: > Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: exception: Instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 could not be found. Aug 24 11:39:23.164494 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: action_args: {'id': '0bbb0462-1cae-4bef-ac83-80e494c84d08'} Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: {{(pid=120722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 could not be found. Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:39:23.165645 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 could not be found. Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 could not be found. Aug 24 11:39:23.167334 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: ERROR nova.api.openstack.wsgi Aug 24 11:39:23.168923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: DEBUG nova.api.openstack.wsgi [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Returning 404 to user: Instance 0bbb0462-1cae-4bef-ac83-80e494c84d08 could not be found. {{(pid=120722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:39:23.168923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO nova.api.openstack.requestlog [None req-e5b8744e-956b-4731-a6c2-33e01af5aea0 tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08" status: 404 len: 111 microversion: 2.1 time: 0.031765 Aug 24 11:39:23.168923 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: [pid: 120722|app: 0|req: 606/1238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:23 2022] GET /compute/v2.1/servers/0bbb0462-1cae-4bef-ac83-80e494c84d08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:39:23.343219 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f92d456-75eb-44ed-a5d5-30df467a7f4a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] Calling method '.version_select at 0x7f5ba4766550>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:23.370214 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f92d456-75eb-44ed-a5d5-30df467a7f4a tempest-TestShelveInstance-1507112614 tempest-TestShelveInstance-1507112614-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1340289180" status: 202 len: 0 microversion: 2.1 time: 0.031278 Aug 24 11:39:23.371157 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 633/1239] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Aug 24 11:39:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1340289180 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:39:43.748885 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:39:43.749507 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Wed Aug 24 11:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:41:24.729291 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:41:24.729930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:41:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:41:27.466176 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:41:27.467935 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:41:39.268058 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:41:39.269094 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:41:50.461834 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:41:50.462426 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Wed Aug 24 11:41:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:43:03.757406 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:43:03.758134 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Wed Aug 24 11:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:43:11.945122 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:43:11.945819 dv-cinder-854275-3-iscsi devstack@n-api.service[120722]: Wed Aug 24 11:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:44:44.737739 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:44:44.738930 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:44:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:44:47.475004 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:44:47.475663 dv-cinder-854275-3-iscsi devstack@n-api.service[120720]: Wed Aug 24 11:44:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!